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ABSTRACT 

The  objective  of  this  research  has  been  to  characterize 
in  terms  of  spectral  representations  and  interval  distribu- 
tions the  univariate  point  process  resulting  from  the  super- 
position of  a  finite  number  of  independent,  identically 
distributed  renewal  processes  with  either  Erlang  or  hyper- 
exponential  interval  distributions.   A  corollary  to  the 
direct  line  of  inquiry  has  involved  a  broad  class  of  uni- 
variate point  processes  known  as  semi-Markov  generated 
point  processes .   A  semi-Markov  generated  point  process 
may  be  thought  of  as  a  superposition  of  dependent  renewal 
processes.   The  spectral  and  distributional  characteristics 
are  developed  for  such  processes  with  finite  state  space, 
and  the  superposition  of  renewal  processes  with  Erlang  or 
hyperexponential  interval  distributions  is  shown  to  have  an 
equivalent  representation  as  a  semi-Markov  generated  point 
process.   Equivalence  here  refers  to  the  probabalistic 
structure  of  the  time  between  events,  and  more  specifically, 
the  spectral  properties. 
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I.   INTRODUCTION 

This  thesis  is  concerned  with  the  analysis  and  proba- 
bilistic properties  of  point  processes  which  arise  from 
superposing  a  finite  number  of  renewal  processes.   Most 
previous  work  in  this  field  has  considered  the  case  where 
the  number  of  superposed  processes  is  very  large. 

The  concept  of  point  process  is  quite  general.   A  point 
process  is  a  countable  set  of  primitive  events  defined  on 
a  continuum.   That  is,  given  a  vector  space,  a  point  process 
is  any  set  of  vectors  defined  on  the  space.   The  research 
recorded  in  this  dissertation  deals  with  a  specific  class 
of  point  processes  defined  en  the  non-negative  real  line, 
(sometimes  called  a  series  or  stream  of  events).   Moreover, 
they  are  univariate  point  processes  or  series  of  events  in 
that  events  are  distinguishable  only  by  where  they  occur 
on  the  real  line. 

Point  processes  arise  naturally  in  a  wide  variety  of 
situations,  both  deterministic  and  stochastic  in  nature. 
For  example,  the  location  of  the  stars  in  the  universe 
relative  to  the  earth  coordinate  and  time  system  is  a 
deterministic  point  process,  while  the  time,  location  and 
magnitude  of  earthquakes  on  the  surface  of  the  earth  may 
be  considered  a  stochastic  point  process. 

The  analysis  of  a  point  process  is  highly  dependent 
upon  the  nature  of  the  process  and  the  questions  to  be 


Hi 


answered.   For  this  reason,  point  processes  have  been 
classified  into  groups  within  which  similar  analytic 
methodology  may  be  applied. 

Section  A  contains  a  discussion  of  some  of  the  various 
classifications  of  point  processes,  with  examples,  followed 
in  Section  B  by  a  description  of  those  particular  point 
processes  which  are  the  subject  of  this  research. 

The  scope  and  limitations  of  the  research  are  delineated 
in  Sections  C  and  D,   with  a  general  overview  of  the  thesis 
presented  in  Section  E.   Some  of  the  more  significant 
results  are  detailed  in  Section  F. 

A  summary  of  previous  work  relevant  to  this  project 
is  presented  in  Chapter  II. 

I. A.   CLASSIFICATION  OF  POINT  PROCESSES 

Recall  that  a  point  process  is  a  set  of  primitive  events 
defined  on  a  vector  space.   Restricting  attention  to  these 
processes  which  are  stochastic  in  nature,  classification 
Is  based  on  the  dimension  of  the  vector  space  and  the  des- 
criptive properties  associated  with  the  primitive  events. 
The  following  subsections  describe  seme  fairly  general 
classes  of  point  processes.   The  names  given  for  the 
classes,  while  not  universally  accepted,  are  commonly  used 
(See  Lewis,  1972,  for  further  discussion). 

I.A.I.   The  Multidimensional  Point  Process 

The  multidimensional  point  process  is  a  set  of 
events  defined  on  a  multidimensional  vector  space.   Typically, 
although  not  exclusively,  the  dimensions  are  those  of  space. 
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An  example  of  such  a  process  might  be  the  list  of 
submarine  sinkings  in  World  War  II  recorded  by  location. 
That  is,  each  element  of  the  point  process  is  identified  by 
latitude  and  longitude  only. 

I. A. 2.   The  Multivariate  Point  Process 

A  multivariate  point  process  is  one  for  which,  in 
addition  to  its  location  in  a  vector  space,  the  events  are 
distinguishable  by  some  other  qualitative  factor.   In  the 
above  example  of  submarine  sinkings,  to  each  location  vector 
might  be  appended  the  parent  alliance  (Allied  or  Axis)  of 
the  lost  submarine.   This  process  would  now  be  classified 
as  a  two  dimensional  bivariate  point  process. 
I . A . 3 .   The  Marked  Point  Process 

A  marked  point  process  is  one  for  which  the  events 
have  quantitative  information  associated  with  each  event. 
An  obvious  example  is  that  of  a  record  of  earthquakes  which, 
in  addition  to  the  time  coordinate,  each  event  has  an 
associated  energy  level  and  location  vector. 

An  example  of  a  univariate,  unidimensional,  marked 
point  process  which  is  easy  to  visualize  Is  that  of  arrivals 
at  a  supermarket  checkout  center.   The  vector  space  is  the 
positive  time  line,  while  the  mark  Is  the  value  of  purchases, 
I. A.  if.   Classification  by  Event  Source  or  Structure 

In  addition  to  the  above  classification  list,  point 
processes  are  categorized  by  special  characteristics  of  the 
source  of  the  events,  or  structure  of  the  process.   The 
definitions  are  not  precise,  and  some  processes  may  fall  in 
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more  than  one  category.  No  attempt,  will  be  made  here  to 
name  all  the  possible  categories,  but  some  examples  will 
clarify  the  idea. 

A  cluster  process  is  one  in  which  some  events  are 
generated  by  a  main  or  driving  process,  while  other  events 
are  in  some  way  triggered  by  the  main  events  (Lewis,  1964; 
Vere-Jones,  1970).   An  example  of  a  cluster  process,  also 
known  as  a  branching  point  process,  is  the  sequence  of 
landing  times  aboard  an  aircraft  carrier.   If  several  air- 
craft are  assigned  a  joint  mission,  the  arrival  of  the  first 
aircraft  of  the  group  might  be  considered  the  main  event, 
with  the  arrival  times  of  the  remaining  members  of  the 
group  being  subsidiary  events. 

Another  classification  of  point  processes  according 
to  event  source  is  the  superposition  of  point  processes 
(Cox  and  Smith,  195^;  Cox  and  Lewis,  1966,  Ch.  8;  Cinlar, 
1972).   Under  this  formulation,  the  observed  events  of  a 
point  process  may  have  originated  in  any  one  of  several  dis- 
tinct point  processes,  but  with  no  indication  of  which 
process  was  the  source.   This  form  of  point  process  is  the 
subject  of  this  research,  and  is  explained  in  more  detail 
below. 

A  third  category  is  the  renewal  process  to  be 
defined  in  the  next  section. 

I.B.   THE  SUPERPOSITION  OF  RENEY/AL  POINT  PROCESSES 

Much  of  the  analysis  of  point  processes  is  directed 
toward  determining  the  underlying  probabilistic  structure 
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of  a  point  process  based  on  information  gained  from  a 
statistical  sample,  or  conversely,  determining  the  statis- 
tical properties  of  a  sample  from  assumptions  regarding 
the  underlying  structure. 

A  univariate  point  process  which  has  been  the  object 
of  extensive  study  is  the  renewal  process.   A  renewal  process 
is  a  univariate  point  process  defined  on  the  non-negative 
real  line  for  which  the  separations  between  adjacent  events 
are  independent,  identically  distributed  random  variables. 
It  is  convenient  when  discussing  unidimensional  processes 
to  refer  to  the  events  as  occurrences  in  time,  and  to  index 
the  events  accordingly.   Thus,  given  events  E.  =  t.  and 
E.  =  t.,  where  the  indices  i  and  j  are  taken  from  the  set  of 
integers,  and  the  times  are  measured  from  some  arbitrary 

origin,  then  t.  <  t.  whenever  i  <  j. 
&   '       l    3 

If  several  independent  renewal  point  processes  are 
operating  concurrently,  then  the  union  or  pooling  of  the 
events  of  all  the  processes,  without  regard  to  which  process 
generated  a  particular  event,  forms  a  superposition  of 
renewal  point  processes  which  is  itself  a  univariate  point 
process.   Figure  I.B.I  shows  graphically  the  superposition 
of  two  univariate  renewal  point  processes.   The  processes 
which  contribute  events  to  the  superposition  process  are 
called  the  component  processes. 

While  in  the  general  definition  of  superposition  it  is 
not  necessary  that  the  component  processes  be  renewal 
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Figure  I.B.I.   Superposed  output  of  two  renewal  point 
processes.   This  illustrates  the  basic  idea  of  a  super- 
position process.   Intervals  in  the  component  processes 
are  independent.   In  general,  the  intervals  of  the 
superposition  process  are  related. 
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processes,  In  this  thesis  the  primary  interest  is  in  super- 
position of  independent  renewal  processes.   However,  in 
studying  these  consideration  is  given  to  multivariate  or 
multitype  processes  called  semi-Markov  processes;  the  com- 
ponent processes  are  dependent  renewal  processes  and  their 
superposition  is  called  a  semi-Markov  generated  point  process . 

Some  examples  will  clarify  the  concept  and  indicate  the 
broad  applicability  of  the  superposition  model  to  point 
processes  which  occur  naturally  in  science  and  technology. 

Example  I.B.I:  Nerve   fiber   pulses.      Cox  and  Smith 
(195*0,  Cox  (1962)  and  Cox  and  Lewis  (1966)  explore  the 
hypothesis  that  the  electrical  impulses  observed  in  a  neuron 
are  responses  to  stimulus  from  several  independent  sources. 
Under  some  distributional  assumptions  regarding  the  component 
processes,  including  the  assumption  that  they  are  independent, 
a  method  was  developed  to  estimate  the  number  of  processes 
generating  impulses  in  the  observed  neuron.   The  methods  are 
very  ad  hoc  and  hopefully  the  results  of  this  thesis  will 
lead  to  improved  methods  of  analysis . 

Example  I.B.2:  Failure  -patterns  of  series  systems. 
In  reliability  theory,  a  series  system  is  taken  to  be  a 
piece  of  equipment  which  is  made  up  of  a  combination  of 
component  parts  such  that  each  component  must  function  in 
order  for  the  system  to  function.  Thus  the  system  fails 
each  time  a  component  fails.  If  each  component  failure 
results  in  replacement  of  that  component  with  a  component 
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having  the  same  failure  time  distribution  as  the  original, 
the  sequence  of  system  failure  times  is  a  univariate  super- 
position process.   Lewis  (196*0  and  later  Downton  (1972) 
examined  this  structure  with  regard  to  the  nature  of  the 
stationary  failure  process  as  the  number  of  the  components 
grows  large . 

Example  I.B.3*  Resupply    of  a    remote    activity .      An 
activity  at  great  distance  from  a  logistics  center  is 
resupplied  by  a  fleet  of  vehicles  which  traverse  a  fixed 
route.   Assuming  that  the  successive  round  trip  transit 
times  for  each  vehicle  may  be  treated  as  a  renewal  process, 
the  arrival  pattern  of  the  entire  fleet  may  be  represented 
by  a  univariate  superposition  process.   Barnett  (1970) 
studied  this  problem  in  order  to  characterize  the  time 
between  arrivals. 

Example  I.B.4:  Demand  for   gas    turbine    engines    for   DD 
962    class    destroyers .   A  class  of  new  U.  S.  Navy  destroyers 
will  each  be  equipped  with  four  gas  turbine  main  propulsion 
engines.   Each  time  an  engine  fails  or  has  been  operated  for 
a  specified  time,  it  must  be  replaced.   The  sequence  of 
replacements  associated  with  a  particular  engine  position 
may  be  taken  to  be  a  renewal  process .   The  demand  for  engines 
emanating  from  all  engine  positions  on  all  ships  is  a  uni- 
variate superposition  of  renewal  processes.   This  demand 
pattern  is  of  interest  to  planners  who  must  arrange  for 
procurement  and  repair  of  the  gas  turbine  engines. 
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Example  I.B.5:  Highway    traffic   analysis.      Automobiles 
passing  a  checkpoint  on  a  multilane  highway  form  a  super- 
position process.   If  a  counter  is  placed  so  that  it  records 
the  passage  of  cars  in  all  lanes,  and  the  stream  of  cars 
in  each  lane  is  taken  to  be  a  point  process,  the  record  of 
the  counter  is  that  of  a  superposition  process.   In  this 
example,  the  component  processes  may  be  distinctly  non- 
Poisson,  non-independent  and  perhaps  non-stationary, 
indicating  the  broad  applicability  of  the  superposition 
process . 

I.C.   RESEARCH  OBJECTIVES 

The  objective  of  this  research  has  been  to  characterize 
in  terms  of  spectral  representations  and  interval  distribu- 
tions the  univariate  point  process  resulting  from  the  super- 
position of  a  finite  number  of  independent,  identically 
distributed  renewal  processes  with  either  Erlang  or  hyper- 
exponential  interval  distributions.   The  ultimate  goals 
were  to  provide  the  methodology  by  which  a  given  set  of  data 
from  a  univariate  point  process  might  be  modeled  as  the 
superposition  of  a  finite  number  of  Erlang  or  hyperexponential 
renewal  processes,  the  determination  of  the  number  of  pro- 
cesses superposed  being  a  key  question,  or  to  provide  means 
of  predicting  the  behavior  of  a  superposition  process  based 
on  assumptions  regarding  the  finite  number  of  independent 
component  renewal  processes. 

A  corollary  to  the  direct  line  of  inquiry  has  involved 
a  broad  class  of  univariate  point  processes  known  as 
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semi-Markov  generated  point  processes .   A  semi-Markov  process 
may  be  thought  of  as  a  sequence  of  independent,  non-negative 
random  variables  sampled  in  accordance  with  a  Markov  chain. 
If  the  sequence  of  times  between  transitions  are  taken  as 
interevent  times  in  a  univariate  point  process,  a  semi- 
Markov  generated  point  process  has  been  defined.   This  is 
the  same  as  the  process  given  in  Cox  and  Lewis  (1966, 
pp.  19*0  for  which  the  analysis  of  a  two  state  process  is 
presented.   The  spectral  and  distributional  characteristics 
are  developed  for  such  processes  with  finite  state  space, 
and  the  superposition  of  renewal  processes  with  Erlang  or 
hyperexponential  interval  distributions  is  shown  to  have  an 
equivalent  representation  as  a  semi-Markov  generated  point 
process.   Equivalence  here  refers  to  the  probabilistic 
structure  of  the  time  between  events,  and  more  specifically, 
the  spectral  properties. 

While  a  prediction  scheme  for  future  behavior  of  the 
superposition  process  based  on  historical  knowledge  of  the 
process  is  not  one  of  the  objectives  of  this  work,  most 
practical  schemes  for  prediction  have  been  based  on  the 
second  order  spectral  properties  which  are  presented  here. 
See,  for  Instance,  Yaglorn  (1962)  or  more  recently  Jowett 
and  Vere-Jones  (1972).   In  this  line  it  should  be  pointed 
out  that  a  crucial  difference  between  classical  time  series 
(sequences  of  random  variables)  and  Intervals  between 
events  in  a  point  process  is  that  the  former  are  almost 


always  assumed  to  be  normally  distributed,  while  the  inter- 
vals in  a  point  process  are  positive  random  variables  and 
very  non-normal . 

I.D.   RESEARCH  LIMITATIONS 

In  addition  to  the  fact,  mentioned  above,  that  the 
prediction  problem  has  not  been  examined,  other  interesting 
and  relevant  topics  have  not  been  considered.   While  a  major 
motivation  behind  the  study  of  superpositions  has  been 
estimation  of  the  number  of  component  processes  (see  Cox 
and  Lewis,  1966,  Ch.  8),  no  effort  has  been  made  here  to 
address  this  problem  directly. 

The  subject  of  data  analysis  with  regard  to  spectral 
and  bispectral  estimation  (see  for  example  Tukey,  1959,  and 
Brillinger  and  Rosenblatt,  196?)  is  an  important  area  which 
complements  the  current  research,  but  is  not  included. 

In  reliability,  the  failure  pattern  of  a  series  system 
may  be  modeled  as  a  superposition  of  renewal  processes 
(Example  I.B.2).   It  might  be  conjectured  that  a  much  broader 
range  of  system  designs  may  be  modeled  as  semi-Markov  genera- 
ted point  processes.   In  view  of  the  results  reported  in 
Chapter  V,  research  in  this  area  might  provide  an  important 
contribution  to  reliability  theory.   It  is  hoped  that  the 
results  presented  in  this  thesis  will  provide  the  basis 
for  future  research  along  some  of  the  above  avenues. 
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I.E.   GENERAL  OVERVIEW 

This  dissertation  can  be  roughly  divided  into  four 
parts.   The  first  part  is  direct  spectral  analysis  of  the 
hyperexponential  and  Erlang  superpositions  (that  is,  super- 
positions of  independent,  identically  distributed  renewal 
point  processes  with  either  Erlang  or  hyperexponential 
interval  distributions) .   Following  is  an  analysis  of  the 
spectral  and  distributional  properties  of  a  semi-Markov 
generated  point  process,  and  the  semi-Markov  generated 
point  process  representations  of  the  Erlang  and  hyperexpo- 
nential superpositions. 

The  third  part  of  the  thesis  involves  study  of  the 
marginal  interval  density  of  the  superposition  of  renewal 
processes.   Finally,  the  formulations  of  the  first  three 
parts  are  developed  computationally. 

Chapter  II  contains  a  summary  of  definitions,  notation 
and  basic  results  regarding  point  processes  in  general 
which  have  application  to  this  research  project.   Also  in 
Chapter  II  will  be  found  a  brief  summary  of  some  of  the 
known  properties  of  superposition  processes. 

Chapter  III  contains  a  detailed  development  of  the 
second  order  spectral  representation  of  the  Erlang  super- 
position process  based  on  the  work  of  Cox  and  Lewis  (1966) 
and  Lewis,  et  al  (1973).   Some  qualitative  results  are 
established  regarding  the  second  order  interval  spectrum, 
and  a  relationship  with  the  second  order  spectrum  of  a 


mixed  autoregressive/moving  average  process  is  given.   An 
expression  is  derived  for  the  second  order  spectrum  of 
counts,  relating  it  to  the  count  spectrum  of  a  component 
process,  and  the  number  of  components.   Some  specific 
Erlang  superpositions  are  examined  in  detail. 

Chapter  IV  examines  the  hyperexponential  superposition 
in  much  the  same  way.   The  development  is  constrained  by 
the  unlimited  number  of  parameters  in  a  general  hyper- 
exponential distribution.   A  two  parameter  model  is  studied 
in  detail. 

The  semi-Markov  generated  point  process  is  defined  and 
analyzed  in  Chapter  V.   This  process  has  been  used  by  Lewis 
and  Shedler  (1973)  to  model  page  exception  processes  in 
multiprogrammed  computers.   The  work  of  Rudemo  (1973)  with 
regard  to  second  order  count  spectra  of  semi-Markov  generated 
point  processes  is  summarized.   Joint  distributions  of  inter- 
vals, serial  covariances  and  higher  order  Joint  moments  are 
derived  for  this  process.   The  second  order  spectrum  of 
intervals  and  the  interval  bispectrum  are  shown  to  be  func- 
tions of  the  Markov  transition  matrix  and  the  marginal 
moments  of  the  process.   A  method  is  indicated  for  obtaining 
higher  order  interval  spectra  of  the  semi-Markov  generated 
point  process. 

In  Chapter  VI,  the  "method  of  stages"  is  used  to  model 
hyperexponential  and  Erlang  superposition  processes  as 
equivalent  semi-Markov  generated  point  processes.   It  must 
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again  be  stressed  that  equivalence  refers  to  probabilistic 
structure,  and  not  physical  structure.   A  state  of  the 
Markov  chain  cannot  be  related  to  a  particular  component 
process,  but  rather  contains  information  regarding  the 
overall  superposition  process.   The  concept  of  lumpability 
is  employed  to  reduce  the  state  space  associated  with  the 
superposition  process  to  a  workable  size. 

In  Chapter  VII  the  marginal  probability  density  function 
of  an  interval  in  a  process  formed  by  superposing  independent 
renewal  processes  is  shown  to  be  a  function  of  the  survivor 
functions  of  the  component  renewal  processes,  following  the 
development  of  Cox  and  Smith  (195*0-   The  relationship  between 
the  number  of  processes  superposed  and  the  initial  value  of 
the  marginal  probability  density  function  of  a  superposition 
interval  is  shown  to  have  a  simple  and  useful  relationship 
to  the  number  of  component  processes.   The  results  derived 
for  the  superposition  of  general  renewal  processes  are 
applied  to  the  Erlang  and  hyperexponential  superpositions. 

Numerical  testing  and  tabulation  of  the  results  of 
Chapters  III  through  VII  are  found  in  Chapter  VIII.   A 
computer  oriented  discussion  covers  such  diverse  topics  as 
the  Fast  Fourier  Transform,  and  algebraic  manipulation  com- 
pilers such  as  FORMAC .   Alternative  methods  of  solving  the 
various  problems  are  suggested  and  evaluated  quantitatively 
with  regard  to  response  to  particular  questions  and  computer 
efficiency.   Several  graphs  and  tables  are  presented  to 
enable  comparison  of  the  various  processes,  and  to  indicate 
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the  type  of  information  available  from  this  type  of  analy- 
sis.  Included  among  the  graphic  displays  are  second  order 
count  and  interval  spectra,  marginal  densities,  and  bispectral 
representations . 

I.E.I.   Thesis  Organization 

Chapters  are  numbered  with  Roman  numerals,  with 
major  sections  designated  by  capital  letters.   Subsections 
are  indexed  within  the  major  sections  by  Arabic  numerals, 
with  further  subdivision  marked  with  lower  case  letters. 
Thus  Subsection  III. A. 2  is  found  within  Section  A  of 
Chapter  III . 

Theorems,  lemmas  and  examples  are  numbered  sequen- 
tially within  chapter  sections.   For  example,  Theorem  III.  A.  5 
is  the  fifth  Theorem  of  Section  III. A.   Equations  are  num- 
bered sequentially  within  sections  and  subsections,  with 
chapter  reference  in  Arabic  numerals,  and  enclosed  in  paren- 
theses.  Equation  (3. A. 2. 12)  is  the  twelfth  numbered 
formula  in  Subsection  III. A. 2. 

The  designation  of  figures  follows  that  of  the 
theorems.   That  is,  Figure  V.A.I  is  first  referenced  in 
Chapter  V,  Section  A. 

Appendices  follow  Chapter  VIII  and  are  designated 
by  upper  case  letters. 

I.F.   SIGNIFICANT  RESULTS 

Despite  the  natural  occurrence  of  superposition  pro- 
cesses, there  are  few  analytical  results  for  finite 
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superpositions  (see  Cinlar,  1972).   In  order  to  fill  this 
gap,  this  research  has  concentrated  on  the  study  of  super- 
positions of  renewal  processes  having  either  Erlang  or 
hyperexponential  distributions.   These  particular  distribu- 
tions were  chosen  because  they  are  reasonably  tractable  from 
a  computational  viewpoint,  and  they  are  sufficiently  flexi- 
ble in  parameterization  that  in  many  cases,  empirical  data 
appears  to  fit  one  of  the  two  forms . 

Several  interesting  results  have  been  established  during 
the  course  of  this  research  which  may  prove  valuable  to 
statisticians  working  with  superposition  processes. 

I.F.I.   Spectrum  of  Intervals  and  the  Relationship  of 

the  Superposition  Process  to  a  Stationary  i'ixed 
'Autoregressive/moving  Average  Process 

A  mixed  autoregressive/moving  average  process  of 
orders  m  and  n  (ARMA  (m,n)  process)  is  a  sequence  of  random 
variables,  {Z,  },  each  element  of  which  is  equal  to  a  linear 
combination  of  the  n  previous  elements  of  the  sequence  plus 
a  linear  combination  of  m  corresponding  random  shocks,  where 
the  shocks  are  independent  and  identically  distributed  with 
zero  mean  and  finite  variance.   A  large  body  of  knowledge 
Is  available  regarding  this  type  of  process  with  respect 
to  identification  of  the  numbers  m  and  n,  and  estimating 
the  linear  coefficients  of  the  model.   The  major  portion  of 
these  procedures  are  based  on  the  serial  correlation  struc- 
ture, or  equivalently  the  second  order  spectral  structure 
of  the  process.   See  for  example  Box  and  Jenkins  (1970). 
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A  superposition  process  is  not  a  mixed  autoregressive/ 
moving  average  process,  nor  can  it  be  modeled  as  one  because 
of  the  non-negativity  of  the  time  between  events.   However, 
the  second  order  spectral  structure  of  the  intervals  of 
the  Erlang  and  hyperexponential  superposition  processes  is 
the  same  as  that  of  a  mixed  autoregressive/moving  average 
process,  opening  up  much  of  the  time  series  methodology 
for  application  to  this  class  of  stochastic  processes. 
This  fact  is  stated  as  Theorem  III. A. 2  with  proof  in 
Chapter  VI . 

When  a  superposition  process  and  an  ARMA  process 
have  identical  second  order  spectral  properties,  the 
processes  will  be  called  similar . 

I. P. 2.   The  Order  of  a  Similar  AJRMA  Process 

With  the  establishment  of  the  fact  that  certain 
types  of  superposition  processes  have  similar  ARMA  pro- 
cesses, it  was  necessary  to  determine  the  relationship  in 
detail.   Given  a  sequence  of  serial  correlation  coefficients 
which  may  be  attributed  to  an  ARMA(m,n)  process,  what  can 
be  saj.d  about  the  similar  superposition  process? 

This  question  was  addressed  In  Chapter  III  from  the 
inverse  point  of  view.   For  specific  superposition  processes, 
the  order  of  the  similar  ARMA  process  was  determined.   For 
a  class  of  superposition  processes,  upper  bounds  on  the  ARMA 
order  were  specified.   In  those  cases  where  a  final  algebraic 
form  for  the  Interval  spectrum  was  determined,  the  upper 
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bounds  were  achieved.   However,  there  is  evidence  that  this 

will  not  always  be  the  case. 

I. P. 3.   The  Structure  of  a  Semi-Markov  Generated  Point 
Process 

p 
The  semi-Markov  process  may  be  thought  of  as  n 

independent,  non-negative  random  variables  sampled  in  accor- 
dance with  a  Markov  chain.   If  the  sequence  of  times  between 
samplings  is  taken  to  be  the  time  between  events  in  a  point 
process,  a  semi -Markov  generated  point  process  has  been 
formed. 

The  joint  structure  of  intervals  in  a  stationary 
semi-Markov  generated  point  process  is  shown  in  Chapter  V 

to  be  an  easily  obtained  function  of  the  transition  matrix 

2 

and  the  n  random  variables. 

Although  this  formulation  has  value  in  its  own 
right,  its  applicability  to  this  research  lies  In  the  fact, 
demonstrated  in  Chapter  VI,  that  the  classes  of  superposi- 
tion processes  under  study  have  equivalent  representations 
as  semi-Markov  generated  point  processes.   That  Is,  the 
univariate  point  process  generated  by  either  the  semi- 
Markov  process,  or  the  superposition  process  have  identical 
probabilistic  structure.   Thus,  in  a  reasonably  direct 
way,  the  spectral  structure  of  all  such  processes  may  be 
determined. 

I.F.JJ.   The  Inverse  of  a  Characteristic  Matrix 

In  Section  3  it  was  stated  that  the  spectral  repre- 
sentation of  the  Intervals  between  events  In  a  semi-Markov 
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generated  point  process  was  an  easily  obtained  function 
of  the  transition  matrix.   In  fact,  the  spectrum  Is  a  linear 
combination  of  terms  of  the  form  (Ix-T)   ,  where  this  term 
must  be  evaluated  for  all  (complex)  values  of  x  for  which 
the  Inverse  exists.   In  Chapter  VIII  this  problem  is 
addressed  and  three  methods  of  solution  are  proposed, 
tested  and  compared. 
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II.   PRELIMINARY  CONCEPTS  AND  RESULTS 

The  objective  of  this  chapter  is  to  establish  the  foun- 
dation upon  which  this  research  has  been  based.   The  work 
of  Cox  and  Lewis  (1966)  provided  much  of  the  point  process 
technology,  sone  of  which  has  been  expanded  here  to  charac- 
terize certain  superposition  processes.   Where  practicable, 
the  notation  of  Cox  and  Lewis  has  been  adopted. 

Section  A  contains  definitions  and  notation,  along  with 
the  development  of  some  basic  results,  with  regard  first  to 
the  general  stationary,  univariate,  unideimensional  point 
processes,  then  for  the  superposition  of  renewal  point 
processes.   Finally,  the  special  notation  peculiar  to  the 
particular  class  of  processes  under  investigation  is  intro- 
duced.  Appendix  A  summarises  the  notation  found  throughout 
'the  thesis  . 

Section  B  contains  a  brief  summary  of  known  results  con- 
cerning the  superposition  of  point  processes  which  are  of 
interest  in  the  context  of  this  research. 

II. A.   PRELIMINARY  NOTATION,  NOMENCLATURE  AND  DEFINITIONS 

Two  distinct  avenues  of  research  are  represented  in  this 
thesis.   The  primary  field  is  that  of  the  superposition  of 
independent  renewal  processes.   A  second  class  of  processes 
considered  are  those  (univariate)  processes  generated  by 
the  transitions  of  a  semi -Markov  process.   These  univariate 
point  processes  are  called  semi-Markov  generated  point 
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processes .   The  interest  In  this  second  class  of  processes 
stems  from  certain  distributional  properties  of  the  hyper- 
exponential  and  Erlang  component  processes  of  a  superposition 
which  permit  the  construction  of  a  semi-Markov  generated 
point  process  equivalent  to  the  superposition  of  independent 
renewal  processes.   The  term  "equivalent  process"  means  that 
the  probabilistic  structure  of  the  point  processes  generated 
by  either  method  is  the  same.   It  must  not  be  inferred  that 
superpositions  of  general  renewal  processes  have  equivalent 
semi-Markov  generated  point  processes,  nor  that  every  semi- 
Markov  generated  point  process  is  equivalent  to  a  superposition 
process . 

While  much  of  the  notation  and  many  basic  definitions 
are  introduced  throughout  this  thesis,  particularly  with 
regard  to  the  semi-Markov  process,  some  will  be  presented 
here  which  are  of  a  general  nature. 

II. A. 1.   The  Point  Process 

From  here  forward,  unless  otherwise  specifically 
stated,  the  phrase  point  process  will  refer  to  a  stochastic, 
unidimensional ,  univariate,  regular  series  of  events.   That 
is  to  say,  the  events  are  defined  on  the  non-negative  real 
line,  and  are  distinguishable  only  by  their  location  on  the 
line.   The  regularity  condition  (Daley  and  Vere-Jone ,  1972, 
Sect.  6)  requires  that  the  probability  of  more  than  one 
event  in  an  incremental  interval,  h,  Is  o(h),  where  the 
limit  as  h  tends  to  zero  of  o(h)/h  is  zero.   A  point  process 
is  completely  count  stationary  if  the  finite  dimensional 
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distributions  of  counts  of  events  in  finite  intervals  are 
invariant  under  translation.   (See  Cox  and  Lewis,  1966, 
Ch.  4.) 

A  point  process  has  four  representations  which  are 
physically  equivalent  in  the  sense  that  knowledge  of  one 
representation  is  equivalent  to  knowledge  of  the  others, 
although  the  translation  from  one  representation  to  another 
is  not  necessarily  simple.   The  representations  will  be 
referred  to  as  the  asynchronous  count  and  interval  processes 
and  the  synchronous  count  and  interval  processes. 

Let  {X  }  be  a  sequence  of  iid  (independent,  iden- 
tically distributed)  non-negative  random  variables.   The 
sequence  {X  }  is,  by  definition,  stationary  since  the  finite 
dimensional  distributions 


Pr[X.  <  x.,...,X.  <  x.]  =  Pr[X...  <  x.,...,X...  <  x,] 
i  -  i      J  -  J        i+t  -  i5    '  j+t  -  j J 

(2. A. 1.1) 

for  all  finite  sets  of  indices  {i,...,j},  and  all  real  valued 
vectors  (x. ,...,x.).   In  a  renewal  theory  context  {X  }  is 
called  an  ordinary  renewal  interval  process .   In  general,  If 
(X  }  is  a  stationary  sequence  of  non-negative  random  varia- 
bles giving  the  times  between  events  in  a  point  process,  it 
will  be  referred  to  as  the  synchronous  interval  process  for 
the  point  process.   The  meaning  of  the  word  "synchronous" 
will  become  clear  in  the  discussion  of  arbitrary  events, 
below. 
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Directly  related  to  the  synchronous  Interval  process 
Is  the  synchronous  counting  process ,Nf (t ) ,  which  gives  the 
number  of  events  in  the  interval  (o,t],  where  o  is  the  event 
time  at  which  the  interval  x,  commences.   In  general  Nf(t) 
is  not  a  process  with  stationary  increments. 

There  are  subtleties  connected  with  the  idea  of 
selecting  an  event  to  start  the  counting  process  which  are 
beyond  the  scope  of  this  thesis.   (See  Daley,  Vere-Jones, 
1972,  for  more  on  the  Palm-Khinchine  theory.) 

To  define  the  asynchronous  counting  process   asso- 
ciated with  the  point  process,  let  the  number  of  events 
which  occur  in  the  interval  (t,t+u)  be  given  by  N(t,t+u). 
Assume  that  t  was  chosen  independently  of  the  stationary 
interval  sequence  {X  }.   Then  it  can  be  shown  that  for  any 
real  value  h, 

Pr[N(t+h,t+h+u)  =  n]  =  Pr[N(t,t+u)  =  n]. 

This  stationary  property  can  be  extended  and  expressed  as 


Pr[N(t1,tp  =  ni;...,N(tk,t^  =  nk] 


=  Pr[N(t1+h,t.J+h)  =  nx,  .  .  .  ,N(tk+h,tk+h)  =  nR] 

(2. A. 1.2) 
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for  any  set  of  k  finite  intervals,  k  =  1,2,...,  and  for  all 
real  h.   Thus,  N(t,t+u),  representing  the  number  of  events 
in  an  interval  of  length  u  from  an  arbitrary  origin,  is  the 
asynchronous  counting  process  and  will  be  denoted  N(u) . 
Stationarity  of  a  point  process  usually  is  taken  to  mean 
that  N(t,t+u)  is  a  process  with  stationary  increments. 

The  asynchronous  interval  process  is  intimately 
connected  to  the  asynchronous  counting  process .   Again, 
taking  the  basic  process  to  be  the  synchronous  interval 
sequence  {X  },  then  the  arbitrary  origin  of  the  asynchronous 
counting  process,  N(u),  will  fall  in  some  interval,  say 
X! .   The  time  forward  from  the  arbitrary  time  of  the  origin 
until  the  next  event  in  the  process,  denoted  W,  is  governed 
by  the  forward  recurrence  time  distribution  (Lawrance,  1970) 


-1   x 
Pr[W  <  x]  =  pw(x)  =  y    /   Rx(u)du, 

o 


where  R„(u)  is  the  marginal  survivor  function  for  an  element 
X  of  the  sequence  {X  },  and  u  =  E[X]. 

Including  successive  intervals,  the  resulting 
sequence  {W,X! , n ,X! . „ , . . . }  =  {W.L. ,LOJ . . . }  is  called  the 
asynchronous  interval  process .   In  general,  the  asynchronous 
interval  process  is  not  stationary  with  respect  to  the  index 
sequence.   The  main  idea  here  is  that  the  sampling,  performed 
by  choosing  an  asynchronous  origin,  picks  out  an  interval 
X!  which  is  length-biased  (Cox  and  Lewis,  1966,  Ch .  k)    and 
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doesn't  have  the  same  distribution  as  the  Intervals  {X  }. 

n 

Moreover  the  effect  persists  to  successive  intervals,  e.g. 

Vi- 

The  following  expressions  will  clarify  the 
relationship  of  the  various  representations: 

N(t)  <  n«t=>W+L1  +...+L  x  >  t,   n  =  1,2,...,        (2. A. 1.3) 


Nf(t)  <  n<=>Xx+X2  +...+  X   >  t,  n  =  1,2, (2. A.  1.4) 


An  arbitrary  event  is  most  easily  explained  in 
terms  of  the  asynchronous  counting  process.   Consider  the 
number  of  events  In  an  interval  of  length  u  following  an 
arbitrary  event.   This  may  be  defined  as  (Khintchine,  I960) 


Pr[N„(u)=n]  =  lim  Pr[N(t+h,t+h+u)=n  |  N(t,t+h)>l]   (2. A. 1.5) 
h-»-0+ 


Equivalently ,  the  interval  following  an  arbitrary  event  is 
X,  of  the  stationary  interval  process,  with  the  index 
origin  chosen  arbitrarily.   The  word  "synchronous"  refers 
to  synchronization  with  an  arbitrary  event. 

The  interval  following  an  arbitrary  event  will  be 
referred  to  as  an  arbitrary  interval . 

If  one  ignores  the  complication  caused  by  the  start 
(asynchronous  or  synchronous)  of  the  process,  it  may  be 
observed  from  (2. A. 1.3)  and  (2. A. 1.4)  that  there  are  two 
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stationary  stochastic  processes,  N(t)  and  {X  },  which  can 
represent  the  process.   Consequently,  there  are  two  (partly 
related)  second  order  analyses  possible:   that  of  the  count 
process,  N(t),  and  that  of  the  interval  process,  {X  }.   Both 
are  useful,  the  relative  utility  depending  on  the  process 
examined.   We  note  that  analysis  based  on  N(t)  is  more 
fundamental,  mainly  because  data  often  comes  aggregated 
(as  the  number  of  events  in  a  day,  for  example)  without 
exact  times  of  events.   In  addition  it  reflects  phenomena 
in  continuous  time.   However,  phenomena  which  are  reflected 
in  serial  number  will  be  more  marked  in  the  interval 
properties . 

Cox  and  Lewis  (1966,  Ch.  H ) ,  develop  several  pro- 
perties associated  with  point  processes.   The  following 
two  subsections  contain  a  summary  of  the  pertinent  portions 
of  that  development. 

II. A. 2.   Properties  and  Characterizations  of  the 
Counting  Process 

Of  interest  with  respect  to  the  counting  representa- 
tions are  the  mean-time  curves,  M(t)  and  Mf(t),  for  the 
synchronous  and  asynchronous  counting  processes,  respectively, 
and  their  intensity  functions,  m(t)  and  mf(t).   Also  the 
covariance  density  function  y(t),  the  variance-time  curve, 
V(t),  and  the  second  order  spectrum  of  counts  for  the 
stationary  counting  process. 


39 


Beginning  with  the  asynchronous  counting  process, 

M(t)  =  E[N(t)]  (2. A. 2.1) 

is  the  expected  number  of  events  in  an  interval  of  length 
t  with  arbitrary  origin.   The  stationarity  of  N(t)  leads 
to 

M(t)  =  t/y  >  (2. A. 2. 2) 

where  y  is  the  expectation  of  an  arbitrary  interval.   The 
variance-time  curve  is  defined  in  a  natural  way  for  the 
asynchronous  process: 


V(t)  =  E[M2(t)]  -  E[N(t)]2  .  (2. A. 2. 3) 


The  mean-time  curve  of  the  synchronous  counting 
process  is,  using  the  relation  (2. A. 1.4), 


Mf(t)  =  E[Nf(t)]  -  I    Pr[Nf(t)>r] 

r=l 


-  I   F  (t)  ,  (2. A. 2. 4) 

r=l  r 


where  F  (t)  =  Pr[Xn  +...+  X  <t],  taking  {X  }  to  be  the 
r  1        r—  n 

synchronous  interval  sequence. 

The  intensity  function  of  a  counting  process  is 
m(t)  =    d/dt(n(t)}  or  mf(t)  -  d/dt {Mf(t ) },  where  m(t)dt  may 
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be  thought  of  as  the  probability  of- an  event  in  the 
infinitesimal  interval  (t,t+dt).   Thus 


m(t)  =   \i    1   =   m,  (2. A. 2. 5) 


and,  when  the  derivative  exists,  from  (2.  A.  2.4) 


CO 

m  (t)  =   £   f  (t),  (2. A. 2. 6) 

r=l 


where  f  (t)  is  the  pdf  (probability  density  function) 
associated  with  F  (t). 

To  develop  the  covariance  function,  let  dN(t) 
denote  the  number  of  events  in  an  increment  of  time.   That 
is, 


dN(t)  =  N(t+dt)  -  N(t) . 


Then,  if  the  process  is  assumed  to  be  regular. 


E[dN(t)]  =  E[(dN(t))2]  =  md  +  o(dt)  (2.  A.  2.  7) 


and,  since  (E[dN(t)])2  =  o(dt), 


Var(dH(t))  =  mdt+o(dt).  (2. A. 2.8) 


Looking  now  at  the  joint  expectation,  for  t  >  0 
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E[dN(t)dN(t+t;3  =  Pr[dN(t)=dN(t+T)=l]  +  o(dt  ) 


=  mdt  PR[dN(t+T)=l  dN(t)=l]  +  o(dt  ) 


mmf(t)dt2  +  o(dt2) . 


(2. A. 2. 9) 


Now  define  the  covariance  density  as 


Y,(t)  =  lim  E[(dM(t)-mdt)  (dN(t+T)-mf>(T)dt)l/dt' 
dt+0  x 


lim  [m(mf(T)-m)  +  o(dt)] 
dt+0 


m{mf(T)-m} 


(2. A. 2.10) 


Maintaining  consistency  with  (2. A. 2. 8)  and  observing 
that  from  the  stationarity  of  N(t),  y_(-t)  =  y,(t),  the 
covariance  density  function  can  be  defined  over  the  entire 
real  line  by 


Y(t)  =  J 


m{m~  (t  )-m}  ,   t  r    0  , 


6(t)m      ,   t  =  0 


(2. A. 2. 11) 


where  6(t)  is  the  Dlrac  delta  function.   This  arises  essen- 
tially from  considering  the  covariance  function  of  the  deri- 
vative of  a  jump  function,  N(t),  which  exists  only  in  the 
sense  of  generalized  functions  (Daley  and  Vere-Jones,  1972, 
Sect.  4). 
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The  Fourier  transform  of  (2. A. 2. 11)  Is 


g(w)  =  (27T)"1    /  Y(t)e"iwtdt,   to  >  0         (2. A. 2. 12) 


where  i  =  v-TT   Since  the  process  is  real  and  stationary, 
m-Ct)  =  m„(-t),  and  in  the  limit  as  t  goes  to  infinity, 
nu(t)  tends  to  m.   This  permits  the  alternative  form  of 
the  count  spectrum  (Cox  and  Lewis,  1966,  p.  7*0 


g+(co)  =  m{l+mf (ia»)+mf (-iw)}/ir,   w  >_  0        (2. A. 2. 13) 

where  m~(s)  =   /  mf(t)e   dt  is  the  ordinary  Laplace  trans- 

o 
form  of  mf(t).   The  form  of  the  second  order  count  spectrum 

given  by  (2.  A.  2. 13)  is  particularly  useful  in  developing 

spectral  forms  in  the  superposition  process. 

Further,  a  very  useful  relationship  exists  between 

the  variance-time  curve  and  the  second  order  count  spectrum: 


lim  V'(t)  ■  it  lim   g  (to),  (2.A.2.14) 

t->°°  o)->0+ 


where  V'(t)  is  taken  to  be  the  time  derivative  of  the 

variance-time  curve,  V(t).   That  is,  the  asymptotic  slope 

of  the  variance-time  curve  is  equal  to  it  times  the  initial 

value  of  the  count  spectrum. 

II. A. 3.   Properties  and  Characterizations  of  the 
Interval  Process 

The  properties  of  interest  related  to  the  interval 

process  are  the  expectation,  E[X],  and  variance,  Var(X),  of 
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an  arbitrary  Interval;  the  coefficient  of  variation, 

1/2 
C(X)  -  CVar^^ ,  (2. A. 3.1) 


the  auto-correlation  sequence  {p.},  and  the  second  order 
spectral  density  of  the  interval  process,  f  (oj)  . 

The  autocorrelation  sequence,  {p.}  is  given  by 


p.    =  (E[XnXn+j]  -  E[X2])/Var(X),   j  =  0,±1,±2,...    (2. A. 3. 2) 


The  second  order  interval  spectral  density  is  the 
Fourier  transform  of  the  autocorrelation  sequence.   That  is, 


f    (u)    =    {1   +    2    Z      p.    cos    joj}/tt.       0    <    to<    it  (2. A. 3. 3) 

j  =  l      J 


An  alternative  formulation  of  the  spectral  density 
of  intervals  has  proven  very  useful  in  this  research.   Let 

4>(z,t)  =  I    zJPr{N(t)=j}  (2.  A.  3.U) 

j  =  0 

be  the  probability  generating  function  for  N(t),  with  the 
Laplace  transform  <J>  (z,s).   Without  going  into  details  (see 
Cox  and  Lewis,  1966,  p.  77)  v/hich  require  a  development 
not  germane  to  this  thesis,  the  interval  spectral  density 
may  be  determined  from 
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r  M  =   «'(elM,o+)  i  £%^o±I         (2>A>3>5) 

{2<J>  (0,0+)  -  E(X)} 


This  relationship  is  the  basis  of  one  approach  to  the 
problem  considered  in  this  research. 

Finally,  a  relationship  exists  between  the  initial 
point  of  the  count  and  interval  spectra: 


g+(0+)  =  C2(X)f+(0+)/E[X]  .  (2. A. 3. 6) 


I I . A . 4 .   The  Superposition  Process 

By  superposition  process ,  as  used  hereafter,  is 

meant  the  union  of  the  events  of  several  independent  renewal 

point  processes.   That  is,  let  N.(t)  be  a  stationary  counting 

process  with  iid  interevent  times,  for  i  =  l,...,p.  Then 

N(p)(t)  =   E   N.(t)  (2. A. 4.1) 

1=1  1 

is  a  stationary  superposition  process.   It  should  be  stressed 
that  this  is  a  univariate  point  process .   There  is  no  iden- 
tification of  an  event  in  the  superposition  with  Its  parent 
process.   An  observation  of  a  superposition  process  is  a 
sequence  of  times  corresponding  to  the  occurrences  of  events, 
with  no  other  identifiable  characteristics. 

In  general,  a  superscript  of  (p)  will  indicate  that 
the  superscripted  symbol  refers  to  a  superposition  process 
of  p  components . 
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II. A. 5.   Special  Superposition  Processes 

An  Erlang  renewal  process  Is  a  renewal  process 
with  Interevent  times  governed  by  the  Erlang  pdf , 


fx(x)  =  Ak  x(k_1)  e~Xx/(k-l)!,   x  >  0.        (2. A. 5.1) 


In  this  thesis,  the  Erlang  pdf  will  be  denoted  by  y  (k,A). 

When  p  iid  Erlang  renewal  processes  are  superposed, 
the  superposition  will  be  called  an  E ( k , p )  process .   With 
regard  to  component  processes,  the  term  "iid"  means  that  the 
processes  are  independent  and  have  the  same  probabilistic 
structure.   The  scale  parameter,  A,  is  suppressed  in  this 
notation.   The  sequence  of  intervals  resulting  from  the 
superposition  of  p  iid  Erlang  renewal  processes  will  be 
referred  to  as  the  synchronous  (asynchronous)  E(k,p) 
interval  process,  depending  on  the  starting  conditions  of 
arbitrary  event,  or  arbitrary  time.   Denote  by  N    (t)  the 
asynchronous  E(k,p)  counting  process  and  by  N^p  (t)  the 
synchronous  E(k,p)  counting  process. 

The  hyperexpcnential  renewal  process  has  interevent 
time  survivor  function 


k 

RY(x)  =  I      q,  exp{-A  x},   x  >  0,  (2. A. 5-2) 

A      J=1   J        J 

k 
where  q.  >  0,  j  =  l,...,k,  and   E   q.  =  1.   The  point  process 

J  .1  =  1   J 

resulting  from  the  superposition  cf  p  hyperexponential 
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renewal  processes  will  be  denoted  as  an  H(k,p;q,_A)  process. 
In  this  notation,  g_  =    (q  ,  .  .  .  ,q  )  and  A_  =  (X  ,  .  .  .  ,X  )  .   The 

usage  of  H(k,p;q_,_X)  will  be  the  same  as  for  E(k,p). 

The  letters  k  and  p  will  be  reserved  for  the  special 
usage  indicated  in  this  section.   Thus,  p  is  the  number  of 
component  processes  in  a  superposition,  and  k  Is  the  shape 
parameter  of  an  Erlang  distribution,  or  the  number  of  ex- 
ponential terms  in  an  hyperexponential  distribution.   The 
exact  interpretation  of  k  will  generally  be  clear  from  the 
context . 

II. B.   PROPERTIES  OF  THE  SUPERPOSITION  PROCESS 

Known  results  regarding  superposition  processes  may  be 
divided  roughly  into  three  categories.   The  first  category 
is  that  of  asymptotic  and  Poisson  related  properties,  and 
is  covered  in  Subsection  II.B.l.   The  second  category, 
dealing  with  the  counting  process  and  the  marginal  interval 
is  covered  in  Subsection  II. B. 2.   Finally,  the  joint  inter- 
val and  spectral  properties  are  listed  in  Subsection  II. B. 3. 

II.B.l.   The  Asymptotic  and  Poisscn  Related  Properties 
of  a  Superposition  Process 

The  relationship  of  the  Poisson  process  and  super- 
position process  is  well  covered  by  Cinlar  (197?)  •   The 
gist  of  the  results  presented  are 

a.   Under  fairly  broad  conditions,  if  a  stationary 
renewal  process  is  the  superposition  of  stationary  renewals, 
each  is  Poisson. 
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b.   As  the  number  of  component  processes  is  increased, 
with  the  time  scale  adjusted  so  that  the  mean  time  between 
events  in  the  superposition  is  held  constant,  the  resultant 
process  is  approximately  Poisson.   There  are  some  subtleties 
regarding  this  asymptotic  result  which  will  not  be  considered 
here  as  they  have  no  bearing  on  this  research.   Essentially, 
the  limit  holds  if  no  component  process  contributes  inordi- 
nately to  the  total  number  of  events. 

II. B. 2.   Count  and  Arbitrary  Interval  Properties  of 
the  Superposition  Process 

Several  properties  of  the  superposition  of  indepen- 
dent, stationary  renewal  processes  are  additive,  and  require 
little  elaboration.   Let  IJ.(t),  i  =  l,...,p,  be  a  set  of 

independent,  asynchronous  renewal  counting  processes,  with 

(■d)  P 

Nvv/(t)  =   E  N.(t).   Clearly,  the  mean-time  and  variance- 

i=l  x 

time  curves  are 

M^p;(t)  =   I  M. (t)  (2.B.2.1) 

i  =  l  X 


and 


V^P;(t)  =  I   V, (t).  (2.B.2.2) 

i=l 


For  ease  of  notation,  suppose  the  component  processes  are 

probabilistically  identical,  where  M(t)  and  V(t)  denote  the 

(c) 
common  forms  for  the  component  processes.   The,  if  X    is 

an  arbitrary  interval  in  a  component  process,  and  X    is 


i<8 


an  arbitrary  superposition  interval 


E[X(p)]  =  E[X(c)]/p.  (2.B.2.3) 


The  pdf  of  an  arbitrary  superposition  interval, 
first  given  by  Cox  and  Smith  (195*0  j  is  (assuming  iid 
component  processes) 


f(p)(t)  =  -  ^Rc(t)(y_1  /  Rc(u)du)P"1},      (2.B.2.4) 


where  R  (t)  is  the  survivor  function  of  the  component  process 

(c) 

interval  and  u  =  E[X    ].   Development  of  this  form  for 

particular  processes  is  presented  in  Chapter  VII  of  this 
dissertation . 

Cox  and  Lewis  (1966)  give  the  result 


m£p)(t)  =  mf(t)  +  (p-l)m  (2.B.2.5) 


based  on  the  idea  that  an  arbitrary  event  in  the  superposi- 
tion process  occurs  at  an  arbitrary  time  in  all  but  one  of 
the  component  processes. 

Enns  (1970)  determined  that  fcr  the  superposition  of 
iid  renewal  processes,  if  the  log  survivor  function  is 
concave  (convex),  then  so  is  the  log  survivor  function  of 
the  superposition  process .   In  the  terminology  of  reliability 
theory,  If  the  component  processes  have  monotone   hazard  rate, 
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then  the  hazard  rate  of  the  superposition  is  monotone  in 

the  same  direction. 

II. B. 3.  .Second  Order  Count  Properties  of  the 
Superposition  Process 

Taking  the  covariance  function  of  a  stationary 

counting  process  as  in  (2. A. 2. 10),  and  using  (2.B.2.1)  and 

(2.B.2.5)  yields  the  covariance  function  of  the  stationary 

counting  process  of  the  superposition 


yjp)(t)  -  m(p)(t){m<p)(t)  -  m(p)(t)} 


=  pm{nf(t)  +  (p-l)m  -  pm} 


■  PY+(t)  .  (2.B.3-1) 

Similarly,  taking  the  Laplace  transform  of  (2.B.2.5) 
and  substituting  in  the  expression  for  the  count  spectrum 
of  a  stationary  process  (2. A. 1.10)  gives 


g|p)(oj)  =  pm{l+mf(ia))+mf(-iw)}A 


=  Pg+(co).  (2.B.3.2) 


These  results  have  the  following  interesting  inter- 
pretation.  If  the  component  processes  are  iid  renewal 
processes,  and  if  g,   (w)  and  p  are  known,  then  so  is  g,(w) 
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This  in  turn  determines  the  interval  properties  of  the 
component  processes.   Thus,  in  theory  everything  is  known 
about  the  process. 

If  p  is  not  known,  however,  it  is  precisely  this 
linearity,  or  additivity,  that  makes  gj   (00)  relatively 
uninformative . 

Note  that  the  intervals  in  the  superposition  process 
are  correlated  and  their  structure  is  complicated  and  diffi- 
cult to  find  in  practice.   However,  it  is  this  complex 
structure  that  makes  their  investigation  (particularly 
second  order  properties)  worthwhile  for  clues  to  the 
underlying  nature  of  the  superposition  process. 

II. B. 4   Second  Order  Interval  Properties  of  the 
Superposition  Process 

There  is,  in  principal,  a  means  of  determining  the 

second  order  interval  spectrum  of  the  superposition  process. 

From  the  definition  of  the  superposition  of  independent, 

identically  distributed  renewal  processes,  and  (2.A.3.M, 

it  is  clear  that  the  generating  function  of  the  superposed 

counting  process  is 

<J>(p)(z,t)  =  £P(z,t).  (2.B.H.1) 


Now,  <{>(z,t)  Is  the  inverse  Laplace  transform  of  <J>  (z,s) 
which,  for  a  renewal  process,  is 


**(z,s)  =    1   "  f  is)         ,  (2. B.I}. 2) 

s{l  -  zf  (s)} 

* 

given  by  Lewis,  et  al  (1973),  where  f  (s)  is  the  Laplace 

transform  of  the  renewal  interval  pdf.   The  Laplace  trans- 
form of  (2.B.4.1)  yields  the  information  required  in 
(2. A. 3.5)  to  determine  f[p)(w). 

The  procedure  outlined  above  is  explained  in  more 
detail  in  Chapter  III.   The  inverse  Laplace  transform  of 
(2.B.4.2)  is  not  a  trivial  problem,  nor  is  the  expansion  cf 
<J>  (z,t)  once  <£(z,t)  has  been  determined.   In  the  case  of 
the  E(k,p)  process,  Lewis,  et  al  (1973)  developed  a  compu- 
tational form  which  is  the  basis  for  a  major  portion  of 
this  research. 

The  joint  density  function  of  several  intervals  in 
the  superposition  process  was  derived  by  Lawrance  (1973) • 
The  basic  argument  can  be  illustrated  in  terms  of  the  joint 
density  of  two  adjacent  intervals  in  the  synchronous  inter- 
val sequence.   Conditioning  on  the  first  interval  starting 
with  an  event  in  process  1  at  t  =  0 ,  the  probability  that 
the  first  interval  is  terminated  in  (t  ,t,+dt)  by  an  event 
in  process  1  and  the  second  interval  is  terminated  in 
(tp,tp+dt)  by  an  event  in  process  2  is 


f1(t1)R2(t2)R1(t2-t1)(u2)  -1  ,  (2.B.4.3) 


where  f.(t),  R. (t)  and  y.  are  respectively  the  pdf,  survivor 
function  and  expectation  of  an  arbitrary  interval  in  com- 
ponent process  I,  i  =  1,2.   Taking  all  combinations  of  pro- 
cesses responsible  for  an  event,  and  starting  conditions, 
expressions  of  the  form  (2.B.3-5)  are  added  to  give  the 
joint  density  of  the  adjacent  intervals  in  the  superposi- 
tion process.   In  the  case  of  two  iid  renewal  processes, 
the  joint  density  of  two  adjacent  intervals  in  the 
superposition  is 


(2) 
T^JY    (xn,xQ)  -  f(x,  )f(x0)      /  R(u)du/y 

1   2  ^ 


+  R(x1)f(x1+x2)R(x2)/y 


+  f(.xjR(x1+xJP.(xJ/u 
1    1   d     d 


+  R(x1)f(x2)R(x1+x2)/y 


Lav:rance  (1973)  used  this  procedure  to  determine  serial 
correlations  of  one,  two  and  three  lags  for  certain  pro- 
cesses.  In  Chapter  V  of  this  thesis,  the  joint  density 
function  for  intervals  of  a  semi-Markov  generated  point 
process  is  derived,  and  used  in  Chapter  VI  to  derive  joint 
information  regarding  the  intervals  of  the  E(k,p)  and 
H(k,p;a,X)  processes. 
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III.   SECOND  ORDER  SPECTRAL  ANALYSIS  OF  THE 
E(k,p)  INTERVAL  PROCESS 

The  second  order  spectra  of  counts  and  intervals  of  a 
point  process  are  available  from  easily  derived  formulae 
(Cox  and  Lev/is,  1966,  Ch.  4).   Lewis,  et  al  (1973)  have 
established  a  computational  method  for  determining  the 
interval  spectrum  of  an  E(k,p)  process.   While  the  compu- 
tational method  is  unwieldy  for  even  small  values  of  k  and 
p,  its  application  provides  considerable  insight  into  the 
use  of  the  interval  spectrum  in  the  analysis  or  modelling 
of  a  point  process. 

This  chapter  deals  at  length  with  the  second  order 
interval  spectrum  of  the  E(k,p)  process,  demonstrating  some 
general  results.   The  interval  spectrum  provides  a  natural 
analytic  tool  for  the  superposition  because  of  the  cyclic 
nature  of  the  process.   For  example,  if  three  processes  are 
superposed,  approximately  every  third  event  comes  from 
process  2.   In  Section  A,  the  general  form  of  the  spectrum 
is  established.   It  is  shown  constructively  that  the  spec- 
trum is  the  ratio  of  finite  degree  polynomials  in  cos(w/k), 
where  w  is  the  argument  of  the  spectrum.   A  theorem  is  pro- 
posed which  relates  the  E(k,p)  interval  spectrum  to  that 
of  a  stationary,  finite,  mixed  autoregressive/moving  average 
process . 

The  special  cases  of  the  E(2,p)  and  E(4,r>)  processes 
are  considered  in  Section  B.   Both  processes  are  shown  to 
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have  spectra  expressible  as  the  ratio  of  finite  polynomials 
in  cos  to,  and  an  upper  bound  on  the  order  of  the  polynomials 
is  established. 

Section  C  gives  the  method  for  determining  upper  bounds 
for  the  orders  of  the  ARMA  process  which  is  similar  to  an 
E(k,p)  process. 

The  second  order  spectrum  of  counts  is  considered  in 
Section  D.   The  results  of  Cox  and  Lewis  (1966,  Ch.  4  and 
8)  with  regard  to  the  count  spectrum  is  applied  to  the 
Erlang  superposition  process.   The  initial  point  of  the  count 
spectrum  is  determined  for  the  E(k,p)  process.   Section  E 
contains  some  remarks  regarding  the  use  of  the  material  of 
Chapter  III  along  with  the  methodology  proposed  by  Cox  and 
Lev:is  (1966)  for  the  characterization  of  point  processes 
and  Box  and  Jenkins  (1970)  for  ARMA  model  identification. 

III. A.   THE  INTERVAL  SPECTRUM  OF  AN  E(k,p)  PROCESS 

We  recall  again  the  idea  that  in  a  rough  sense,  the 
spectrum  of  intervals  will  be  mere  informative  in  analyzing 
superpositions  than  the  spectrum  of  counts.   This  Is  because 
the  interval  spectrum  relates  to  the  phenomena  related  to 
serial  number  and  on  the  average,  every  p-th  event  comes 
from  a  given  process.   This  serial  number  effect  is  a 
"hidden  periodicity"  in  the  data.   In  this  section  two 
methods  of  direct  computation  of  the  second  order  spectrum 
of  intervals  of  an  E(k,p)  process  are  discussed.   First, 
the  method  of  Lewis,  et  al  (1973)  which  has  been  used 
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successfully  to  generate  numerical  representations  of  the 

E(k,p)  interval  spectra  for  various  values  of  k  and  p. 

The  second  method  for  determining  the  E(k,p)  interval 

spectrum  is  a  variation  on  the  first  which  simplifies  the 

determination  of  an  analytic  expression  in  the  form  of  the 

ratio  of  two  cosine  polynomials.   This  second  method  is 

satisfactory  for  small  values  of  k  and  p. 

III.A.l.   The  Computational  Form  Of  The  E(k,p)  Interval 
Spectrum 

The  interval  spectrum  of  a  stationary  point  process 
is  defined  to  be  the  Fourier  transform  of  the  auto-correla- 
tion coefficients.   That  is  (2. A. 3. 3) 


CO 

f+(»)  =  £=      I      P,  e-ijaJ  (3. A.  1.1) 


where  i  is  the  square  root  of  -1,  and 


E{[X„-E(X)][X,  , .-E(X)]} 
Pj VirTYl '      J    "    ±ls    ±2 


For  the  asynchronous  process,  let 

M(t)  »  (the  number  of  events  in  (0,t]), 

and  denote  the  generating  function  of  this  asynchronous 
counting  process  by 


CO 

4>(z,t)  =  I    zn  Pr(N(t)  =  n)    0  <  z  <  1.   (3. A. 1.2) 

n=0 
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Denote  the  Laplace  transform  of  <j>(z,t)  by 


CD 

4>*(z,s)  =   /  e"st  <J>(z,t)  dt.  (3. A. 1.3) 

0 


Since  |<f»(zst)|  <_  1  for  all  z  and  t  >_  0 ,  this  transform 
exists  at  least  for  Re | s |  >  0.   Cox  and  Lewis  (1966,  Ch.  4) 
have  shown  that  (3. A.  1.1)  can  be  expressed  in  terms  of 
(3- A. 1.3)  by  (2. A. 3. 5) 


f  (»)  =  IlUlI&I    +  /(e-^,0+)  O.a.1.4) 

{2£  (0,0+)  -  E(X)} 


Lewis,  et  al  (1973)  noted  that  in  the  case  of  the  super- 
position of  renewal  processes,  the  Laplace  transform  of 
a  component  asynchronous  counting  process  is  easily  obtained 
from  the  Laplace  transform  of  the  interval  distribution.   In 
particular,  using  the  identity  for  the  synchronous  process 
(2.  A.  l.ll) 


n 
Nf(t)  >  n<=^>  I   X,  <  t  ,  (3. A. 1.5) 

j  =  l  J 


the  generating  function  of  the  synchronous  counting  process 
is 


<{>f(z,t)  =   E  zn  {pn(t)-F  +1(t)}  »         (3- A. 1.6) 
n  =  0 

n 
where   F  (t)  ■  Pr{  EX,  <  t},   and   F  (t)  =  1.   Then  the 

J  =  l  J  " 
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Laplace  transform  of  (3. A. 1.6)  is 


<K(z5s)  =  -±± 1    ^H   ,  (3. A. 1.7) 

1        s{l  -  zf  (s)} 


oo 

where  f*(s)  ■   /  est  dP(t) . 

o 

Cox  and  Lewis  (1966,  Ch.  4)  provide  the  relation- 
ship between  the  generating  functions  of  the  synchronous 
and  asynchronous  processes: 


<J>(z,t)  =  1  +  wYV  f   4>^(x,u)  du  .        (3. A. 1.8) 


ETXT  qj  V 


The  Laplace  transform  of  (3. A. 1.8)  is 


♦"(,,.) -|+  (g-i»i-fV.)> — 

S    s^  E(X)  {1-zf  (s)} 


■  =  sE ( X ) { 1- ?  f * ( s ) }  +  ( z-1 ) { 1- f * ( s ) } 

s2E(X){l-zf "(s) } 

(3. A. 1.9) 

x 

Thus  £  (z,s)  for  one  of  the  (identically  distributed) 

component  processes  is  a  function  of  the  Laplace  transform 
of  the  interval  density.   Note  further  that  the  generating 
function  of  the  pooled  asynchronous  process  is,  since  the 
component  processes  are  assumed  to  be  independent, 

fnx  N.(t)+.  ..+!!  (t) 

♦(p)(z,t)  =  E[z  T  P    ] 
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Nn(t)   p 
=  (E[z  X    ]} 


4>P(z,t)  (3. A. 1.10) 


The  information  required  for  determining  the  Laplace 
transform  of  the  asynchronous  superposed  process  is  now 
available  and  can,  in  principle,  be  used  in  the  following 
procedure : 

<j>  (z,s)   ->  if>(z,t)  *   4>P(z,t)  ■>  $  ip;(z,s)  ,      (3. A. 1.11) 

where  L  and  L  ~  denote  the  Laplace  transformation  and  its 
inverse,  respectively. 

Example  III.A.l.  The    E(2}2)    process.      We  now 
determine  the  Laplace  transform  of  the  generating  function 
of  the  asynchronous  counts  in  the  E(2,2)  process.   The 
Laplace  transform  of  the  Erlang  density  function  is 


f*(s)  =  (1  +  s/X)  2  (3.  A.  1.12) 


'■. : .  i 


E(X)  -  2/X  .  (3. A. 1.13) 


Substituting  (3. A. 1.12)  and  (3. A. 1.13)  in  (3. A.  1.9)  leaves 


i* 
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,*/   _x  _     2s  +  (3+z)  A .  h 

<$>    (ZjS)  -  p p—   .         (  3  .  A  .  1 . 1 4  ) 

2{X  (1-z)  +  2Xs  +  s^} 


To  invert  (3. A. 1.14),  it  is  convenient  to  substitute 
a  =  -X(l+  z)  and  b  =  -X(l-  z),  so  that 


»'<z's)  -   2(s-a)U-b]   ■  (3. A. 1.15) 


Use  of  a  standard  inversion  formula  (Gardner  and 
Barnes,  19^2;  Seiby,  1969)  results  in 


4>(z,t)  =  (b2eat  -  a2ebt)/(4X/2)  .         (3.A.1.16) 


The  generating  function  of  the  superposed  process 
is  then 


<fr(2)(z,t)  =  $2(z,t) 


_  r.l\    2at  _.4,_   ,2  -2Xt,  1  2bt,/M<.2  s 

=  {b  e    -^X  (1-z)  e    +a  e    }/(16X  z) 


(3- A. 1.17) 


The  Laplace  transform  of  (3. A. 1.17)  is 


b     2X  (1-z)   .   a 

4*(?)(z,s)  =      s-?a  ~ ^2  sn2b_>   (3iA>1.l8) 

-l6x  z 
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To  continue  the  general  case,  Lewis,  et  al  (1973) 
give  the  general  form  for  the  generating  function  of 
asynchronous  counts  in  an  Erlang  renewal  process: 


♦(z,t)  =  (z-l)2/(k22)  E  {t./(t  -l)2}exp{-X(T  -l)t} 

(3.  A. 1.19) 


where  t-,...,t,  are  the  k  distinct  roots  of  z.   Using 

1         K 

(3- A. 1.19)  to  form  the  corresponding  generating  function 
for  the  superposed  process  results  in 

n  P   ,         ,  -A  E  (t  ,-l)t 

♦  ^(■.t)  =  (1^)    E  ...    E  /n-A^e   JbJ   J 

k^z  /   j  =1     J  =iVjeJ(t.-D7 

x        P        J      (3. A. 1.20) 


where  J  =  (j-,  , jn> .  .  . ,  j  )  is  an  index  vector  whose  components 
id       p 

run  from  1  to  k.   The  Laplace  transform  of  (3. A. 1.20)  is 

t  . 

v  i    \                      //„  i\2N    k       k   ,  ,   (  t  .  - 1 ) 
f*<P>(z,s)  -  f^M    E   •■•   E   ^ 3- 


k  z   /  j  =1    j  =1   (s-X).E(x  -1) 

(3- A. 1.21) 


Further,  it  can  be  shown  that  by  letting 


Qx(k,p)  =  {[2<j>*(p)(0,0+)-k/(pX)]} 


-1 


that 


r.i 


ffp)  (co)  =  Q.(k,p){(l-cosa))P/(Ak2p)}  L...Z       — ^ — I 

Jl=    Jp"     '   J  bJJCJ 


(3. A. 1.22) 


where 


aj  =  p  -  1    cos( — £ — )  , 
,i  e  J 


b7  =   E  sm( — fr — )  , 
J   j  e  J      k 


and 


c7  -   n  {l-cos(^^)}  .  (3. A. 1.23) 

J    jeJ         k 


This  computational  form  was  used  by  Lewis,  et  ai 
(1973)  to  generate  numerical  representations  for  several 
E(kjp)  processes,  and  for  k  =  2,  p  =  2,  3  and  4  analytic 
expressions  were  derived.   It  will  receive  more  attention 
in  Chapter  VIII  below  with  regard  to  computation  of  interval 
spectra  numerically. 

It  should  be  noted  that  Q,Ck,p)   (3- A. 1.22)  is 

difficult  to  evaluate  directly.   Two  methods  of  determining 

Q,(k,p)  are  discussed  in  Chapter  VIII. 

III. A.  2.   A  Variation  Of   The  Computation?!!  Fothod  For 
Determininr  F,  (k,n)  interval  ■  ';  antra 

The  computational  form  (3. A.  1.22)  lias  proven  very 

efficient  in  the  numerical  representation  of  E(k,p)  Jnterval 
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spectra.   The  modification  proposed  in  this  subsection  is 
designed  to  assist  in  deriving  an  analytic  expression  for 
the  second  order  interval  spectrum  of  an  E(k,p)  process. 
In  particular,  the  relationship  of  an  E(k,p)  second  order 
interval  spectrum  and  the  spectrum  of  an  ARMA  process  is 
explored . 

An  ARMA(m,n)  process  has  a  spectral  representation 
which  is  the  ratio  of  two  finite  polynomials  in  cosine  co. 
That  is,  for  the  ARMA  (m,n)  process, 


n      3 
I    a. cos   go 

f+(w)  =  ^~— >  (3. A. 2.1) 

1       r 
T.    S  cos   oo 

r=0  r 


where  the  limits  of  summation  correspond  to  the  orders  of 
the  autoregressive  and  moving  average  components  of  the 
ARMA  process. 

It  will  be  shown  (Theorem  III. A. 2;  Chapters  V  and 
VI)  that  the  E(k,p)  second  order  interval  spectrum  has  the 
form  of  (3. A. 2.1),  hence  second  order  serial  properties 
identical  with  those  of  an  ARMA  process. 

This  subsection  contains  the  framework  through 
which  upper  bounds  for  the  parameters  m  and  n  of  (3. A. 2.1) 
may  be  established. 

Observing  that  a,,  b,  and  Cj  (3. A. 1.23)  depend  only 
on  indices  in  J  and  not  on  the  order,  (3. A. 1.22)  can  be 
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written  in  the  alternative  form 


f[p)(.)  =  Qx(k>P)(1-^5")P  I   (J) 


N  2aL 


n 


■  i  2p        AL  /  ,2  .,2  ,     ' 
Xk  *  n=l   n   (a^  +b^  )c^ 

n   n   n 

(3- A. 2. 2) 

where  L   =  (rn,...,r,  )  is  a  vector  of  dimension  k  corres- 

ponding  to  each  distinct  vector  J  which  indicates  the  number 

of  elements  of  each  denomination  in  J.   (The  elements  r., 

of  L      should  retain  the  subscript  n  to  indicate  their 

relationship  to  L    .      This  form  of  notation  rapidly  becomes 

awkward  and  where  there  is  no  ambiguity  the  subscripts  will 

be  suppressed.)   For  example,  let  k  =  5  and  J  =  (3,5,353)- 

The  corresponding  index  designation  vector  is  L   =  (0,0,3,0,1). 

V,'e  will  call  L      an  index  designation  vector.   The  notation 
n    £ 

(  ,  )  is  taken  to  be  the  multinomial  coefficient  p!/(rn!...r,  !), 

v  w  i    k 

and  represents  the  number  of  distinct  permutations  of  J. 

k  /k+p-1" 

It  should  also  be  noted  that   Z  r.  =  p,  and  that  N  =  f 

j=l  J  \   P 

is  the  figurate  number  for  k  types  of  objects  taken  in  sets 
of  size  p  (see  Riordan,  1958,  pp.  25).   In  this  notation, 
further  suppressing  the  subscript  n,  the  terms  of  (3- A. 1.23) 
may  be  written 


a.  =  p  -   E  r.  cos( — £ ) 

j=l  J       k 


6 'i 


b,  -   Z  sin(^j^)  , 


and 


c,  =   n  {l-cos(^^)}  -1   .  (3. A. 2. 3) 

j  =  l         k 


Clearly,  the  coefficients  (  -,  )  do  not  depend  on  the 


p 

I 

n 

order  of  the  elements  in  L    .   It  will  be  convenient  to  com- 

n 

bine  in  a  single  set,  R.,  t  -  1,...,T  those  vectors,  L    , 

which  are  made  up  of  the  same  elements.   Thus  we  take 

R,  =  {(r  ,  ...,r,  )}  to  be  the  set  of  distinct  k-vectors  with 

elements  {r,  ,  .  .  .  ,r,  }  in  any  order.   L  e  R,  will  refer  to  a 

particular  index  designation  set.   In  the  above  example, 

I        =  (0,0,3,0,1)  ar.d  L fcl  =  (3,1,0,0,0)  would  both  be  members 

of  the  same  set,  R.  =  {(3,1,0,0,0)}.   We  now  restate  (3- A. 2.2) 

as 


fjp)(to)  =  Q.(k,p)  (1-°^  ")P  hi)    I       -y— ?—  -C3.A.2.U) 
+        A        >k^p     t-lVY  LeRt(aJ+bpcL 


(o ) 
In  this  form,  f|K  (u.0  can  be  examined  in  detail  by  examining 

the  groups  of  similar  terms,  i.e.,  terms  with  index 

designators,  L,  all  taken  from  the  same  set,  R  . 

In  the  following  pages  the  form  of  the  right  hand 

side  of  (3.A.2.4)  will  be  examined  in  detail.   It  will  be 

shown  in  Lemmas  III.A.l  and  III. A. 2  that  the  right  hand 


r 


r . 


side  is  expressable  as  the  ratio  of  finite  polynomials  in 
cosine(co/k)  j  with  the  term  (1-cos  w)p  cancelling  out  of  the 
expression.   The  proofs  are  constructive  and  the  algebra  is 
cumbersome.   However  the  exposition  is  considered  necessary 
for  the  computational  work  which  will  be  addressed  in 
Chapter  VIII. 

Lemma  III.A.l:   For  some  integer  k  greater  than  1, 
let  R,  be  the  set  of  k-tuples  whose  elements  are  distinct 
permutations  of  { (p,0  ,0  ,  .  .  .  ,0  ) }  .   Denote  the  elements  of  R, 
by  L    j  n  =  1, . . . ,k.   Then 


.  ,    p(k-l) 
v  2a,         (2"  x)p  l  d.cos(nu/k) 

Z   — g i =  5 (3- A.  2.  5) 

n=l(a^  +D,  }cL  p(l  -  cos  to) 

n   n   n 


for  some  real  sequence  {d. }. 

J 

Proof:   From  (3. A. 2. 3),  and  denoting  by  n  'the 

subscript  L     ,    we  have   a   =  p{l-cos( — : )},  b   =  psin  — : ) 

n  n  k       n  k 

and  c   =  {1-cos  (  vr}   0)) }'  ,      n  =  l,...,k.   Evaluating  a 
typical  term, 


2        ,2  2r,     _         /2Tm+CiK     ,  2,2irn+oj,  2 , 2  Tin-Ko  n  > 

a      +   b      =   p    {l-2cos( — : )    +    cos    ( — : )    +    sin    ( — : )} 

n  n  k  k  k 


=    2p2{l-cos(?TT^+(")}    =    2pa    ,      n  =    l,...,k.    (3. A. 2. 6) 


66 


Using  (3. A. 2. 6)  gives 


2a 
n 


(3. A. 2. 7) 


2   p 
(a  +b^)c      pc 


and  (3-A.2.5)  becomes 


k    2ao  k  - 

E  — ^Aj —  =  -  I  —  .  (3.A.2.8) 

n=l  (aSb^)c    p  n=l  cn 
n   n   n 


A  common  denominator  for  (3. A. 2. 8)  is 

D  =  p   II   c   =  p{  II  [l-cos(-2^f^)]}P. 
n=l   n     n=l         k 

Jolley  (1961,  p.  200)  gives   n  {1-cos  (2™+a)) }  =  21_k(l-cos  u) , 

IK. 

with  proof  credited  to  E.P.  Adams  of  the  Smithsonian 
Institute.   Thus 

D  =  p{21_k(l-cos  w)}p.  (3- A. 2.9) 

Given  the  common  denominator,  D,  the  numerator  in 
(3.A.2.8)  is 


k 
N  =  I        n  {l-cosC^g-"-)}7,  .  (3.  A.  2. 10) 

3=1  n^j  K 


Using  the  standard  trigonometric  Identities 


67 


cos(a+b)  =  cos(a)cos(b)  -  sin(a)sin(b)  , 


and 


sin(a+b)  =  sin(a)cos(b)  +  cos(a)sin(b)  ,      (3. A. 2. 11) 


It  Is  easily  shown  that 


2Trn+a) 


cos  ( — : )    =    cos  (io/k)cos  (2-rrn/k)    -   sin  (w/k)  sin(  2-rrn/k) , 


cos(2Trn/k)    =    cos  (2tt  (k-n)/k) , 


and 


sin(27rn/k)    =   -sin  (  2tt  (k-n)/k )  .  (3-A.2.12) 


Using    (3. A. 2. 12),    (3. A. 2. 10)    may   be   expressed   as 

* 

k  p 

N  =      Z    {[l-cos(w/k)cos(2Trn/k)    +    sin(w/k)  sin  (2-rrn/k)  ] 
n=l 

P 
+    [l-cosU/k)cos(2Wk)    -    sin  (w/k)  sin(  2Trn/k)  ]    } 

2  2      p 

x{    I    [(l-cos(u)/k)cos(2irn/k))      -    (sin(w/k)sin(2im/k))    ]} 

j/n 

* 

k  2  2 

+    {   n    [(l-cos(w/k)cos(2Tm/k))      -    (sinw/k)  sin(  2Tin/k) )    ]}U(k) 
J=3 

( 3 .  A .  2 . 1 3 ) 


C8 


where  k  =  [_(k-l)/kj  ,  and 


P  P 

{1+cos (u/k) }   +  {1-cos (w/k) }  ,   k  even 


U(k)  =  < 


^{l-cos(aj/k)}   , 


k  odd 


The  symbol  |_xj  is  taken  to  mean  the  largest  integer  less 
than  or  equal  to  x. 

The  product  terms  in  (3. A. 2. 13)  have  components 


2  2 

(1-cos  (2Trn/k)cos  (w/k)  )   -  (sin  (2-rrn/k)  sin(oj/k)  ) 


=    1   -sin2(2im/k)    -    2cos  (u/k)  cos  ( 2irn/k)    +    cos2(to/k) 


=    {cos(2irn/k)    -   cos  (w/k))    ,      n   =   l,...,k  (3-  A.  2.14) 


Let   A      =    1   -    cos  (  2Trn/k)  cos  (u/k)    and 
B      =    sin(27rn/k)sin(w/k) .      Then   components   of   the    first   term 


of    (3- A. 2. 13)    can   be   written 


P  P  P    /PA  d-1        1  J 

(A    +B    )       +    (A    -B    )       =       I      P)     {Ap    J[BJ+(-B    )     ]} 
n     n  n     n  .    nvj/        n         n         n 


=   2      E 
J  =  0 


& 


flP-2JB2j 

n  n 


(3- A. 2.15) 


where   p      =    [ ( p  + 1) /' 2  J  .      Since   B     =    sin(2im/k)sin(w/k) , 


n 


B2J    =    {sin2(2Trn/k)C(l-cos2(u)/k)]}'1  .      Using   the   results    of 
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(3. A. 2.14)    and    (3. A. 2. 15),    (3. A. 2. 13)    can  be   written 


k        P  P-2j 

N   =    2    E    {    E    C  *Y)  [1-cos  (w/k )  cos  (2Wk)] 
n=l  j=Ow^ 


2J 


J 


x[sin(27m/k)]        [1-cos    (co/k)]    } 


2  P 
x{    II    [cos(2irn/k)    -    cos  (co/k)]    } 

jVn 

k  2  p 

+  {  n  [cos(2im/k)  -  cos(co/k)]  }  U(k) 
n=l 


(3. A. 2. 15a) 


where 


j  =  0 


2j 


2j 
[cos  (co/k)]   ,       k  eve: 


U(k)  =< 


[1-cos (to/k)]   , 


k  odd 


Examination  of  ( 3 • A . 2 . 15a) reveals  that  it  is  a 
polynomial  in  cos(co/k).   The  degree  of  the  polynomial  is 
most  easily  determined  from  inspection  of  (3. A. 2. 8). 
Writ inn 


P    i  c 
n  =  l  n 


E   n  c 

_  n  =  l  ;'/n   * 


k 

p  n  c 
n=l 


n 
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it  is  clear  that  each  term  of  the  numerator  has  at  most 
degree  (k-1)  times  the  degree  of  c  .   Since  each  term 


P 

c   =  {(l-cos(2rn/k)cos(to/k)  +  sin(2irn/k) sin(co/k) }  , 
n 


it  is  of  degree  p.   Thus  there  exists  a  set  of  coefficients 
{d  }  such  that,  using  standard  trigonometric  identities 
(Appendix  B) 

_   P(k-l) 

N  =   E     d  cos  '(cu/k)  , 
n=0    n 

thus  completing  the  proof  of  Lemma  III.A.l. 

It  is  worth  noting  that  the  expression  p(k--l) 
represents  a  weak  upper  bound  on  the  degree  of  the  numerator 
term,  II.   A  tighter  upper  bound  on  the  degree  is 
k[p(k-l)/kj,  which  follows  from  Theorem  III. A. 2  below. 
This  fact  is  important  in  the  comparison  of  the  E(k,p) 
interval  spectrum  with  that  of  a  mixed  autoregressive /moving 
average  process. 

Having  established  in  Lemma  II. A. 1  the  form  of  a 
special  class  of  terms  of  (3. A. 2. 2),  the  more  general  form 
is  considered  below.   Lemma.  III.  A.  2  will  show  that  all  terms 
of  the  E(k,p)  interval  spectrum  can  be  expressed  in  terms 
of  cos  (oj/k)  . 


Lemma  III.  A.  2:   Let  R   be  the  set  of  all  distinct 
permutations  of  the  k-tuple  (r ,  ,r^  ,  . . . ,r .  ) ,  with  r.  >  0,  a 


nd 
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the  sum  of  the  r.  equal  to  p.  Denote  the  elements  of  R 
by  L  ,  n  =  1, . . . ,N,  where  N  Is  determined  from  specific 
knowledge  of  R  .   Then 

Wt 

2aL  E   d.cos  & 

N        Ln  .  0  J     k 

I      — 2 2 =   N    (3- A. 2. 16) 

n=l  (a,  +b,  )ci      t        .    ,  „^a    r 

L  L     <-  _  J  CO    I- COS  CO 

n   n   n    £   s.cos  V"  — r— - = — 
m=0   J     k    2k_1 


v;here  r  =  max.{r.},  and  W.  =  N,  +  kr  -  p  . 
J   J        t    t 

Proof:   It  will  be  shown  first  that  in  constructing 

a  common  denominator  for  (3.A.2.16),  all  terms  containing 

odd  powers  of  sin(u/k)  cancel,  while  even  power  terms  have 

a  cosine  representation.   Following  this,  it  will  be  shown 

that  the  same  phenomena  occur  in  the  numerator  when  the 

expression  is  placed  over  a  common  denominator. 

Examine  the  denominator  of  (3.A.2.16)  first.   The 

k  r 

terms  c,  ,  L    e    R  ,  are  of  the  form   n  {l-cos( — ~— — ) }  n  ,  and 

1  z  n=l         K 

have  as  a  common  multiple, 

k        2  ■  +   r 

II  [l-ccs( — -T- — )]  ,  where  r  is  the  largest  of  the  v., 

n=l        K  J 

j  =  l,...,k.   Recalling  the  result  stated  in  (3. A. 2. 9), 

write 


D   =  (21-k(l-cos  w)}  (3. A. 2. 17) 


which  coincides  v;lth  one  term  in  the  right  hand  side  of 
(3. A. 2.16)  . 
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For  the  index  designation  vector  L    =    (r. , . , . ,r,  ) , 

applying  the  identities  (3. A. 2.11)  gives 


a.  =  p  -  cos(co/k)  E  r.cos(2iTj/k)  +  sin(w/k)  E  r  sin(  2irj/k)  , 
1  3  =  1  J  3=1  J 


and 


b      =    cos(oj/k)    E    r .  sin(2irj/k)    +    sin(to/k)    E    r  .  cos  (  2iTj/k) 
L  3=1   J  3=1   J 


(3. A. 2. 18) 


Using    (3.  A.  2. 13),    form 


1.     +   b.     =    p      +      E    v.    +    2    E         E         r   r .  cos  ( 2  ( 3-n)ir/k) 
L  L  3=1  J  n-1  J-n+1  n  J 

k  k 

-    2p{cos(o)/k)    I    r.cos(2irj/k)    -    sin(to/k)    E    r .  sin  (  2tt.1  /k)  } 
3=1   J  j  =  l   J 


=   V     -    2p{cos(aj/k)    E    r.ccs(2irj/k)    -    sin(u/k)    E   r  .sin(  2irj/k) ) 
1  3=1   J  j=l   J 


k 

L  J 

(3. A. 2. 19) 


with  V   suitably  defined. 

Nov;,  let  r!  -  r,  ..1=1,...  ,k-l,  and  let  r'  =  r,  . 

1    k-i  k    k 

Then  the  vector  L'  =  (r'  ...,r')  will  be  referred  to  as  the 
counter  element  of  L    in  R.  .   By  applying  the  identities 
(3-A.2.11),  the  following  expression  is  realized: 
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2    2 
aL,+bL,  =  VL 


k  k 


-2p{cos(w/k)  E  r.cos(2TTj/k)  +  sin(w/k)  E  r .  sin(  2ttjA)  } 
3=1  J  3=1  J 


(3.A.2.20) 


which  differs  from  (3-  A.  2. 19)  only  in  the  sign  of  the  final 
summation. 

For  each  element  L   of  R,  there  may  be  at  most  one 
counter  element  V    so  formed.   Where  such  a  counter  element 
is  formed,  a  common  multiple  of  the  denominator  in  terms  of 
(3- A. 2.16)  will  include  the  product  of  (3. A. 2. 17)  and 
(3.A.2.1S).   This  product  is 


V2  -    ^p2{  E  r.sin(27T,Vk)}2 
3=1  J 

k 
-  4pV.{  E  r.cos(2TTti/k)}cos(w/k) 
'   3-1  J 

+    4p2cos2(u/k){[    E    r.cos(2iTJ/k)]2 

3=1  J 

k  ? 

+  [  E  r  sin(2;rj/k)]  }  (3-A.2.21) 

3  =  1  J 


which  is  a  second  degree  polynomial  in  cos(a)/k). 

It  is  possible  that  some  elements  of  R      will  not 
have  counter  elements.   This  will  occur  when,  for 


7H 


L   =  (r  ,...,r  ),  r.  =  r'^-±)>    i  =  l».««»k-l.   In  this  case 

k 

E  r.sin(2Trj/k)  =  0. 
j  =  l  J 

2   2 
Thus  no  sin(oj/k)  terms  will  appear  in  a,  or  (a,  +b,  )  .   Hence 

the  denominator  can  be  expressed  as  the  product  of  N~ 

second  degree  polynomials  in  cos(w/k)  and  N..  =  N  -  2N„ 

first  degree  polynomials  in  cos(to/k),  along  with  D   (3.  A.  2. 17) 

Here,  N„  is  the  number  of  element  pairs  in  R,  which  are 

mutually  counter  elements.   As  noted  after  Lemma  III.A.l, 

N  is  a  weak  upper  bound  on  the  degree  of  the  denominator. 

A  more  restrictive  upper  bound  actually  realized  in  some 

test  cases  is  V.      =   k[N/kJ  . 

Having  established  the  form  of  the  denominator  in 

(3-A.2.16),  we  continue  v.rith  the  proof  of  Lemma  III.  A.  2 

by  examining  the  numerator.   Again,  let  L  and  L'  be  counter 

elements  of  R  .   Placing  just  these  terms  over  a  common 

denominator  gives  the  expression 


1c  r — r ' 

UL    =    2£L(aL2,+bL2,)  n  {l-cos(^+-^)}    j 

j  =  l 

+  2a/,(a/2+b,2)  n  {l-cos(27T;1+aJ)}    J         (3-A.2.22) 

where  r  is  the  maximum  element  of  L. 

Again,  imposing  the  identities  (3. A. 2. 11)  and 
(3. A. 2. 12),  the  product  terms  of  (3. A. 2. 22)  are 
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n  u-cos(^r^)H 
J-i  k 

k  z! 

=      n    {l-cos(u/k)cos(2TTJ/k)    +    sin(w/k)sIn(27TJ/k) }   J 
J  =  l 

z!  _.    _ 


=      n    {    Z    [l-cos(2Trj/k)cos(to/k)]   J       [sin(27rj/k)sin(w/k)  lm(J)} , 

j  =  l  m=0  vmy 

(3. A. 2. 23) 


and 


n  {i-cos(^4^)}Zj 

k  j  z .  -m 


n    {    Z    [-cos(2TTj/k)cos(co/k)]    J       [-sin  (2iTJ/k)  sin  (w/k)  ]m(  J)} , 

J  =  l  m=0  xn 

(3- a. 2. 24) 


where  z.  =  r  -  r..   Clearly,  (3. A. 2. 23)  differs  frcn  (3-  A.  2. 2>i) 
only  in  the  sign  of  the  coefficient  of  the  odd  powers  of 
sin(oj/k)  . 

Continuing  with  the  proof  of  Lemma  III. A.  2,  to 
simplify  the  exposition,  in  (3. A. 2.18),  (3. A. 2. 19)  and 
(3.A.2.20)  make  suitable  substitutions  to  let 


a.  =  p  -  A  +  BsinCw/k) 


a  ,  =  p  -  A  -  Bsin(w/k) 


(aL+bI)    =    {VL  "   A   +   Bsi«Cu/k)}2p 
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(af ,+bf t )    =    {VL   -   A  -   Bsin(w/k)}2p 


so  that   in    (3.A.2.22) 


a    (a2,+b2,)    -    2p[V  p-pA-AV  +A2-B2sin2 (w/k ) 


+  B(VL-p)sin(w/k)]  (3. A. 2. 25) 


and 


aL,(a2+b2)    =    2p(VLp-pA-AVL+A2-B2sin2(to/k) 


-    B(Vr-p)sin(w/k))  (3.  A.  2. 26) 

Again,  (3. A. 2. 26)  differs  from  (3. A. 2. 25)  only  in  the  sign 
coefficient  of  sin (w/k). 

Similarly,  the  product  cf  (3. A. 2.24)  and  (3. A. 2. 26) 
differs  from  the  product  of  (3. A. 2. 23)  and  (3. A. 2. 25) 
only  in  odd  powers  cf  sin(co/k),  hence  summing  these  two 
products  will  result  in  the  cancellation  of  all  odd  powers 
of  sin (w/k),  leaving  only  the  even  powers  which  are  readily 
convertible  to  even  powers  of  cos(w/k). 

Thus,  each  pair  of  terms  corresponding  to  mutually 
counter  elements  of  R    ,  when  placed  over  a  common  denominator, 
form  a  numerator  which  is  a  polynomial  in  cos(w/k).   To  put 
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the  entire  expression  (3. A. 2.16)  over  a  common  denominator 
it  remains  only  to  multiply  N   in  (3. A. 2. 22)  by  a  term  of 
the  type  shown  in  (3. A. 2. 21)  for  each  remaining  pair  of 
mutually  counter  elements  in  R.  ,  and  a  term  of  the  type 
shown  in  (3.A.2.20)  with  the  coefficient  of  sin(w/k)  set 
to  zero  for  each  remaining  element  of  R  .   This  will  retain 
the  form  of  a  polynomial  in  cos(w/k),  thus  establishing 
the  nature  of  the  numerator  in  (3.A.2.16).   It  remains  in 
the  proof  of  Lemma  III. A. 2  to  derive  the  degree  of  the 
numerator  as  a  polynomial  in  cos(oo/k). 

The  degree  of  the  polynomial  N   (3. A. 2. 22)  when 
placed  over  a  common  denominator  is  typical,  and  will  have 
degree 


W  =  2  +  2(Np-l)  +  N-  +   E  (r-r.), 

1        ±=1  x 


where  Np  is  the  number  of  pairs  cf  mutually  counter  elements, 

k 
N..  is  the  number  cf  elements  without  counters  and   E  (r-r.) 

1=1    x 
is  the  number  of  terms  which  must  appear  in  the  numerator 

to  include  D   (3. A. 2. 17)  in  the  denominator.   Since 

c  k 

N   =  N  -  2Np,  W  =  N  +   E  (r-r.)  and  the  proof  of  Lemma 

1         d  i=l    x 

III. A. 2  is  complete. 

As  before,  W  actually  represents  a  weak  upper 

*     1    1 
bound,  with  a  more  realistic  bound  being  W  =  k[W/k] . 

An  important  implication  of  Lemmas  III.A.l  and 

III. A. 2  is 
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Theorem  III.A.l:   The  second  order  Interval  spectrum 
of  the  E(kjP)  process  may  be  written 

N 

E  a  cos  (to/k) 

f{p)(to)  =  Qx(k,p)  ^-^ .  (3. A. 2. 27) 

X  £  cos  (w/k) 
m=0  m 

The  proof  of  Theorem  III.A.l  is  a  trivial  application  of 
Lemmas  III.A.l  and  III. A. 2.   Its  value  lies  in  that  the 
interval  spectrum  of  the  E(k,p)  process  can  be  written  in 
the  form  of  the  ratio  of  finite  degree  polynomials  in  cos  (to/k). 
Computational  experience  (discussed  in  detail  in  Chapter 
VIII)  leads  to  the  following: 

Theorem  III. A. 2:   Let  fjP^(to)  be  the  second  order 

interval  spectrum  of  an  E(k,p)  process  expressed  as  in 

(3. A. 2. 27).   Then  the  right  hand  side  of  (3.  A.  2. 27)  can 
be  reduced  to 

N'   , 

i      a    cos  to 

f|P)(w)  =  Qx(k,p)  ^— " (3. A. 2.28) 

£   (3  cos  to 
m=0 

where  N'  =  [N/kJ,  and  M'  ==  [M/kJ  . 

Discussion:   The  difference  between  (3. A. 2. 27)  and 
(3. A.  2. 28)  is  that  the  former  has  polynomials  in  cos  (to/k) 
while  the  latter  has  polynomials  in  cos  to.   The  significance 
of  this  theorem  is  that  it  shows  the  spectrum  of  intervals 


79 


of  an  Erlang  superposition  to  be  the  same  as  that  of  a 
mixed  autoregressive/moving  average  process.   This  permits 
much  of  the  analysis  described  by  Box  and  Jenkins  (1970) 
to  be  applied  to  analysis  of  these  superpositions. 

Even  though  the  Intervals  of  the  superposition 
process  are  distinctly  non-normal,  the  second  order 
properties  upon  which  much  time  series  analysis  is  based, 
are  the  same  for  both  processes. 

Proof  of  Theorem  III. A. 2  will  be  deferred  to 
Chapter  VI,  where  it  is  shown  to  be  a  special  case  of 
Theorem  V.B.3.   Theorem  V.B.3  ascribes  the  form  of  (3. A. 2. 29) 
to  the  interval  spectrum  of  a  semi-Markov  generated  point 
process,  while  Chapter  VI  deals  with  modelling  the  E(k,p) 
process  as  such  a  process. 

It  might  be  conjectured  that  all  spectra  which  can 
be  expressed  in  the  form  of  (3. A. 2. 27),  which  is  not  the 
ratio  of  rational  functions  of  to ,  could  be  further  reduced 
to  the  form  of  (3. A. 2. 28).   That  this  conjecture  is  particu- 
lar to  the  processes  considered  here  and  not  true  in  general 
is  shown  by  the  following  example: 

oo 

Let  f.(u)  =  I      2"Jcos  j  co;   Q  (k,p)  =  1,  k  =  2, 
j  =  0  X 

N  =  1  and  M  =  3.   Let  the  coefficients  in  the  numerator  of 

(3. A. 2. 27)  be  8  and  -9.   Let  the  coefficients  of  the 

denominator  be  10,  -9,  -8  and  6.   The  assertion  of  Theorem  III. A. 2 

is  that  the  coefficients  of  cos(lo/2)  and  cos(3co/2)  must 

be  zero  In  (3.  A.  2. 27).   Some  simple  calculations  will  verify 

that  (3. A. 2. 27)  represents  an  identity  in  this  case. 


8Q_ 


III.B.   SPECIAL  CASE  RESULTS:   E(2,p)  AND  E(4,p)  INTERVAL 
SPECTRA 

The  E(2,p)  and  E(4,p)  processes  are  particularly  amenable 

to  analysis  because  of  the  simple  form  of  the  expansions 


cos  ( ili+H)  =  (-l)J'ccsU/2), 


i    =    1,2, 


(  3  •  B  .  1 ) 


sinC^1^)  =  (-DJ+1sin(a>/2),   J  =  1,2,.. 


(3.b.2) 


COS(  -f-      )  =  "S 


(-l)Jsin(w/4),    j  =  1,3,5,.. 


(-l)J/2cos(a)/4),  j  =  2,4,6,.. 


(3.B.3) 


.   /2TTJ  +  UK    J 

sin(-J-)  -  <| 


(_1)(j-l)/2cosUi/1))j  j  =  lj335j 


(-l)j/2sin(W/i|),     3-2,4,6, 


(3.B.4) 


In  the  discussion  v/hich  follows,  terms  of  the  form  cos(noj) 
and  (cos  to)   will  be  treated  interchangeably,  except  where 
the  exact  coefficient  of  a  term  is  significant  to  the 
discussion.   This  is  justified  by  the  trigonometric  iden- 
tities and  the  Chebyshev  polynomials,  both  summarized  in 
Appendix  B,  which  relate  the  two  forms. 

III.B. 1.   The  E(2,p)  Interval  Spectrum 

A  tediuous  but  straightforward  construction  of  the 
E(2,p)  interval  spectrum  leads  to  the  following 
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Theorem  III.B.l:   The  second  order  spectral  density 
of  the  E(2,p)  interval  process  can  be  written  as  the  ratio 
of  two  polynomials  in  cos  to  as  in  (3. A. 2. 28),  where  N1  =  p-1 
and  mf  =  [(p-l)/2j . 

Proof:   For  a  given  value  of  p,  the  class,  Q.,  of 
index  designator  sets  is 

0.  =    {(P,0),(p-l,l),...,(p-|p/2j-,  [p/2J)>.      (3.B.1.1) 

Prom  Lemma   III.A.l,    for  L   =    (p,0),    and  L   =    (0,p), 
in   the   notation  of    (3. A. 2. 3), 

d      P 
Pa  P_  2P      £    d.    cos(jaj/2) 

2al .    lV ..  3  =  0   3 


(a, +b,  )c,  (a,  ,+b/",)c,  ,  p(l-cos    w)p 

L      L      L  l         l         L  (3.B.1.2) 


which  will  be   denoted  by   P    . 

Looking  more   closely   at   the   numerator  of    (3.B.1.2) 


P  1 

NQ   =    c      +    c    ,    =    {l-cos(to/2)}      +    {l+cos(u/2)} 


lp/2|  Q. 

-    2      E      (g\  cos^Cw/2) 


J  =  0 


=    2      E      (   P^   (1  +  cos    w)    ,  (3-B.1.3) 

j=0   V    y 


Using  appropriate  trigonometric  identities  and 
making  the  obvious  substitutions,  (3.B.1.3)  can  be  written 
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[P/2J 

N   =   E    d,  cos  Ju>.  (3-B.1.4) 


A  second  obvious  case  arises  v.-hen  p  is  even,  and 
L   =  (p-(p/2),p/2)  =  (p/2,p/2).   Then  from  (3. A. 2. 3),  (3-B.l.l) 
and  (3.B.1.2),  a,  =  p,  b^  =  0  and  c^  =  1,  giving 


2aL/(a^+b^)  =  2/p,  (3.B.1.5) 


which  makes  no  contribution  to  the  hypothesized  ratio  of 

polynomials.   VJhen  it  is  defined,  the  expression  (3.B.1.5) 

will  be  denoted  P  /0. 

p/2 

The  general  term  in  the  E(23p)  spectrum  is 
R   =  { (p-n,n) , (n ,p-n) } .   In  this  case,  with  L   =  (p-n}n) 
and  L'  =  (n,p-n),  we  examine  the  expression 

2a,  2a  , 

Pn  =  772-2-—  +  :  2  J    —  '  (3.B.1.6) 

(a,  +b|_)cL    (a^  ,+bL  ,  )c^, 

with  a,,  b,  and  c,  as  in  (3. A. 2. 3). 

Using  (3.B.1.1)  and  (3.B.1.2)  gives 


a.  =  p  +  (p-2n)cos  (u/2)  , 


aL,  =  P  -  (p-2n)cos(co/2)f  (3.B.1.7) 


so  that 
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(a2+b2)  =  2{p2-2pn+2n2+(p-2n)cos(w/2)}, 


(a2,+b2,)  =  2{p2-2pn+2n2-(p-2n)cos(oj/2)}3     (3.B.1.8) 


n  p-n 

cL   =  (l+cos(u/2))  (l-cos(w/2))     , 


and 


p-n  n 

c,,  =  (l+cos(u>/2))    (l-cos(w/2))  .  (3.B.1.9) 


The  common  denominator  in  (3.B.1.6)  becomes 


D   =  {A2-B2cos2(co/2)}{1-cos2(oj/2)} 
n     n  n 


2   2   2  p_n 

=  {2A  -B  -B  cos  to}{(l-cos  u)/2}    /2,       (3. B. 1.10) 
nnn  ' 


using  standard  trigonometric  identities,  substituting 

2        2 
A   =  p  -2pn+2n   and  B   =  p-2n,  and  recalling  from  (3.B.1.1) 

and  (3.B.1.5)  that  n  ranges  from  1  to  [(p-l)/2j  . 

The  numerator  of  (3.B.1.6),  with  (3. B. 1.10)  as  a 

common  denominator,  is 


p-2n 


Nn  =  (p+Bnccs(to/2))(An-Bncos(w/2))(l+cos(w/2)) 


p-2n 
+  (p-B  cos(to/2))(A  +B  cos(co/2))(l-cos(u/2)) 
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N      =    {p+A   +B    (A   -p)cos(w/2)-B    cos2(w/2) 
n  n     n     n  n 


P-2n        0  j 

x      E      (p  "7^  cos    (u/2) 
1=0    \     J     / 


3  =  0 


+    {p+A   -B    (A   -p)cos(w/2)-B2(cos2(w/2)} 


x      E       (P  /^  (-cos    03/2) 


3=0 

-2         ,J 


|P-2ni 
=    2{p+A   -B^cosd(co/2)         E  ( p~.    ")  cos       (u/2) 


[Eflj 


+    2{B    (A   -p)}      E 
n     n  . 

3  = 


PT2^    cos2(w/2)  . 


(3.  B. 1.11) 


Again  making  simplifying  substitutions  and  invoking 
the  appropriate  trigonometric  identities,  (3-B.l.ll)  can 
be  expressed  as 


|P^2n| 

2         3 

N   =   E     d.  cosJ  co. 

n   j=o    J 


(3. B. 1.12) 


Combining  (3. B. 1.10)  and  (3. B. 1.12)  in  (3.D.1.6) 

gives  P   =  N  /D  .   The  next  step  is  to  evaluate  the  summation 
n    n   n 


m 

E    P 
n=0 


P-1 


2  J    -,-,       \n  N 
>    20-cos_o0 n_#(3>B>1<13) 


n    (1-cos  oj)P  n=0   {2A2-B2(l+cos  to)} 


Recall  that  In  (3. A. 2. 3)  there  is  a  factor  (1-cos  to) 
so  that 

IP-1 


II 

fip)(U)  =  Q.(2,p)(1-cof  ">*      E    P 

+         A        X4P     n=0   n 


Qx(2,p) 


P-l 
2  J 


,n  N 


1         2i1-g0S  (o) — a-  .   (3.B.1.14) 


X4H     n=0   {2A2-B2(l  +  cos  to)} 

n   n 

Assume  p  is  even.   Then  each  numerator  term.  (1-cos  to)   N 

n 

is  a  polynomial  in  cos  to  of  order  (p/2) ,  n  =  0 ,1 ,  .  .  .  ,p/2-l . 

When  the  (p/2-1)  denominator  terms  are  combined  into  a  common 

denominator,  the  term  N   is  multiplied  by  a  polynomial  of 

order  (p/2-1),  resulting  in  a  polynomial  of  order  (p-l), 

which  is  the  maximum  degree  of  any  of  the  numerator  terms. 

Thus  for  p  even,  N'  and  M1  of  the  theorem  are  confirmed. 

Let  p  be  odd.   In  this  case  each  numerator  term 

(1-cos  to)   N   is  a  polynomial  In  cos  to  of  degree  ((p-l)/2), 

n  =  0,1, . . . , (p-l)/2.   The  product  of  N  with  the  product  of 

o 

the  (p-l)/2  denominator  terms  results  in  a  polynomial  of 
degree  (p-l),  which  is  the  maximum  of  all  the  numerator 
terms,  and  again  N'  and  M'  are  confirmed,  thus  completing 
the  proof  of  Theorem  III.B.l. 

Some  specific  examples  were   computed  by  Lewis  et 
al  (1973)  and  the  results  are  shown  in  Fig.  VIII. A. 11. 
III.B.2.   The  E(H,p)  Spectrum 

The  construction  of  the  interval  spectrum  of  the 
E(J],p)  process  is  also  tediuous,  but  has  value  in  that  a 
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property  common  to  all  Erlang  superpositions  is  illustrated, 
That  is,  if  L      and  L      are  members  of  the  same  index 
designator  set  the  terms  a,  ]_  and  a,  q  may  have  significantly 
different  form.   For  example,  let  k  =  6  and  p  =  3-   Take 
L°   =    (2,l,0,Q,0,0)and  L1= (2,0 ,0 ,1 ,0 ,0)  so  that,  as  in 
(3.A.2.3) 


„    (2-ft+oj)        (47T+0)) 
a.  o  =  p-2cos- t — -  ~  cos- — -? — - 


-   p-cos(u/6)  {2cos(oj/3)  +  cos  (2u/3) } 


+  sin(w/6)  (2sin(oj/3)+sin(2co/3)}  (3-B.2.1) 


and 


-    (2tt+oj)       (8tt+co) 

i.-i  =  p-2cos- -r—^   -  cos- -?-— - 

Lx  6  b 


=  p-cos(oj/6){2cos(oj/3)  +  cos(  W3)l 

+  sin(w/6)  {2sin(co/3)  +  cos(  W3)} 

=  p-cos  (w/6)cos  (aj/3)  +  sin(aj/6)sin(co/3)  .    (3.B.2.2) 

The  difference  between  (3.B.1.1)  and  (3.B.1.2)  evolves  from 
the  identity 

cos((2iTj+n)/2n)  =  -cos  (2-rrj/2r.)  .  (3-B.2.3) 
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To  construct  the  E(4,p)  interval  spectrum,  It  is 
necessary  to  identify  those  terms,  a  ,  which  are  distinct 
Comparison  of  (3.A.2.3)  and  (3.B.3)  reveals  that  each  a, 
can  be  represented  as 


aL  =  p  +  n^inU/4)  +  n2cos(w/4)  >  (3.B.2.4) 


where  -p  <_  n  ,  n  <_   p  and  |n  |  +  |n  |  <_  p .   A  typical  set 
of  index  designators,  R  ,  contains  the  permutations  of  the 
non-negative  integers  {1,  ,1?  ,1_  ,1^  }  .   From  these  permutations 
are  derived  the  terms 


aL.  =  p±(l  -l1)sin(w/4)±(llj-l2)cos(w/4),  J  =  l,...,^i, 

aLj  =  p±(l4-l2)sin(w/4)±(l3-l1)cos(a)/4),  j  =  5,.  ..,8, 

aLj  =  p±(lil-l1)-sin(u/4)±(l3-l2)cos((o/4),  j  =  9,.  ..,12, 

aLj  =  p±(l3-l2)sin(o)/^)±(l4-l1)cos(w/J4),  j  =  13, ...,15, 

a,.  =  p±(l2-l1)sin(w/4)±(lI}-l3)cos(a)/4),  j  =  17,. ..,20, 

ai.j  =  P±(l[,-l3)sin(h)/A)±(l2-l1)cos(u/4)J  j  =  21,. ..,24, 

(3.B.2.5) 
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Using  (3'B.1.5)  is  inadequate  for  the  analysis  as  can  be 
seen  by  looking  at  two  distinct  sets  of  index  designation 
vectors  R   ■  {1,2, 3, 4}  and  J?2  =  {2,2,3,3).   Denoting 
L.  e  R-,  by  1.  and  L,    e  R?  by  2.  we  have 

2^4  8         16 

{a  }     =  {a   }    =  {a      } 
j  3=17      J  3=1     di   j  =  9 

This  redundancy  must  be  considered  when  deriving  a  common 
denominator  for  (3. A. 2.4). 

To  relieve  this  difficulty  define  the  set 
S(p)  =  <snjm}>  n>  =  1,2,...,  [(p/2)-nJ,   n  =  1,2,...,  [p/2j, 
where 

S    =  (p-2m-n,n).  (3-B.2.6) 

n,m    ^      ' 

Tabulating    S(p)    gives 

S(p)    =    {(p,0),(p-2,0),...,(p-2[p/2j,0), 

(p-l,l),(p-3,.),.. -,((p-2  [(p/2-lj-l,l), 


(p-[p/2j,  [p/2j)K  (3.B.2.7) 
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Each  element  corresponds  to  a  set  of  ordered  pairs 
{(±n  ,±n2) , (±n2,±n1)}  as  shown  in  (3.B.2.4)  and  (3.B.2.5), 
and  each  pair  (n. ,n„)  has  exactly  one  corresponding  element 
of  S(p),  i.e.,  (|n1|,|n2|)  or  (|n2|5|n1|). 

The  special  notation  developed  here  for  the  E(4sp) 
superposition  process  can  be  used  advantageously  to  prove 
the  following 

Theorem  III.B.2:   The  second  order  spectral  density 
of  the  E(^5p)  process  can  be  written  as  the  ratio  of  two 
polynomials  in  cos  oj  as  in  (3.  A.  2. 29),  where 


N* 


< 


(p^+5p-6)/4,   p  =  2,5,6,9,10,.  .  . 


(pN^p-lO/il,    p  =  3,^,7,3,11,12, 


(3.B.2.8) 


(p^+2p-4)/4, 


M'  ■  < 


^jw^Oj  •  •  • 


(p  +2p-3)/4,   P  =  3,5,7,.  .. 


(3.B.2.9) 


Proof:   Corresponding  to  each  a   of  (3.  A.  2. 4)  is 


the  term 


(a.2L+b2L)    =   p2+n^+n2  +  2p(n1sin(w/4)+n2cos(w/^4)) 


(3.B.2.10) 
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The  exact  form  of  c.  (3-A.2.3)  is  not  available 
from  the  pair  (n-,n?).   This  problem  is  easily  handled  in 

the  computation  of  the  denominator  since  the  contribution  of 

1-k  p 

all  the  c,  terms  is  p(2    (1-cos  w)r  as  stated  in  (3. A. 2. 8) 

The  problem  in  the  numerator  is  more  complex  and  will  be 

solved  indirectly  following  the  construction  of  the 

denominator. 

It  Is  convenient  to  partition  the  set  S(p)  into 

subsets .   Let 


51(p)  =  {(p,0)} 


S2(p)  =  {(p-2J,0),    j  =  1,...,  L(P-D/2j} 


S  (p)  =  {(j  ,j )  ,      j  =  l,...,p/2>,  p  even 


s\p)  =  {(0,0)},  p  even 


and 

I) 
S5(p)  =  5(p)  -  Msv(p)  .  (3.B.2.11) 

v=l 

First,  a  denominator  will  be  developed  for  the 
terms  corresponding  to  particular  elements  of  each  of  the 
subsets  listed  in  (3.B.2.11).   The  denominator  corresponding 
to  Sx(p)  is  given  by  (3. A. 2. 9).   S  (p)  will  also  have  the 
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denominator   given   by    (3. A. 2. 9)    with  p    in   that    expression 
replaced  by   j    =   p/2-l,p/2-2, .  .  .  ,p/2- [p/4J  s    inclusive,    hence 

making  no   contribution   to   the   denominator. 

2 

A  typical  term  of  S  (p)  is  (n  ,0),  which  from 

(3. B. 2.10)  and  (3. A. 2. 3),  and  using  standard  trigonometric 
identities,  has  corresponding  common  denominator 


D2   =    {p2+n^+2pn1sin(a3/M{p2+n^-2pn1sin(w/^)} 


2      2  2      2 

x{p   +n   +2pn1cos(td/1})  }{p   +n   -2pn.cos  (w/4  )  } 


(p    +n")    +{(p^+n^)2pn1}d+2pMn^-i|p   njcos    to    .  (3.B.2.12) 


A   typical   element   of  5    (p)    will   yield   the    common 
denominator 


D3   =    {p2+2n2+2pn1(sin(w/^)  +  cos(aj//l)} 


x{p2+2n2+2pn,  [sin  («/!»  )-cos  U/4  )  ]} 

x  J. 


x{p2+2n2-2pn1[sin(co/^)-cos(oj/4]} 


(p2+2n2)24-{2(p2+2n2)pn1}2+8pI]nJ(l+cos  to)  ,       (3-B.2.13) 


again  derived  from  standard  trigonometric  identities 
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5 
Finally,    a   typical   element   of  S    (p)    yields    the 


common   denominator 


D     =    {p'+n^+n2+2p[n1sin(w/iJ)+n2cos(a)/4)]} 


x({p2+n^+n2+2p[n2sin(u/4)+n1cos(u/^)]} 


x{p2+n2+n2+2p[n2sin(w/il)-n1cos(co/4)]} 


x{p2+n2+n2+2p[n1sin(w/^)-n2cos(w/1)]} 


x{p2+n2+n2-2p[n1sin(co/4)-n2cos(aj/4)]} 


2      2      2 

x{p   +n_  +n2-2p[n2sin(w/4 )-n, cos (w/4 ) ]} 


x{p2+n2+n2-2p[n2sin(w/il)+n1cos(aj/4)]} 


x{p2+n2+n2-2p[n1sin(o./4)+n2cos(aj/4)]} 


I|  2 

{(p2+n2+n2)      -    (2p(p2+n2+n2))    (n2+n2) 


1|     4     1}  2 

+   2p    (nn+nn) (1-cos   w)} 


p    ji    |j  & 

-    6'lp°n   n5  (1-cos   u)        .  (3.B.2.1H) 
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The  degree  of  the  denominator  polynomial,  M'  in  (3.B.2.9), 
is  the  sum  of  the  degrees  of  the  common  denominators  for 
each  element  of  S(p).   The  cardinality  of  S(p)  is 


|S(p)|  - 


[P/2J 

I    (j+1) 
j=0 


r(p2+6p+8)/85 


p   -    2,4,6,.  .  ., 


< 


(p^+4P+3)/8,        p  =   1,3,5, 


(3.B.2.15) 


Similarly, 


|S1(p)|    =    1 


|S    (p)|    =     L(p-l)/2j    =    < 


p/2-1,        p   =    2,4,6,..  .  , 


(p-l)/2,    p   =    3,5,7,...  , 


S3(p) 


-   s 


p/2,        P   -    2,4,6,.. ., 


0,  p   =    3,5,7,  •  .  •  , 


|s\P) 


1,        p    =    2,4,6, .  .  .  , 


\ 


0,        P  =    3,5,7,.. ., 
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[$5(p)|  =  |5(p)|  -  I    |Sv(p)| 

v=l 


=  < 


p(p-2)/8,   p  =  2,k,6,.  .  .  , 


(P  -D/8,    p  =  3,5,7,.  . 


(3.B.2.16) 


From  (3.B.2.12),  (3.B.2.13),  (3-B.2.14)  and 
(3. B. 2.16), 


M'  =  |S2(p) |{degree(D2)}  +  |S3(p) | {degree (D  ) } 


+  |5- (p) | {degree(Dr)} 


=  < 


(p/2-l)+(p/2)+2p(p-2)/8,    P  =  2,11,6,..  ., 


(p-l)/2+2(p  -9)/8,         P  =  3,5,6,..., 


r(p2+2p-10/4, 


=  < 


k 


(p2+2p-3)A, 


P  =  2,4,6,..., 


P  =  3,5,7,. . ., 


which  is  (3.B.2.9)  of  the  Theorem. 

Continuing  with  the  proof,  begin  analysis  of  the 
numerator  with  S  (p).   The  numerator  for  this  set  of  terms, 
from  (3. A. 2. 10),  (3.B.3)  and  (3.B.4)  is 
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_  p  p  p  p 

N1  =    (l-cos*(w/lO)    {(l-sinCw/H))      +    (l-sin(w/4))    } 

?  P  P  P 

+    CL-sIrr(o>/4))    {(1+cGsCw/JO)      +    (l-cos(w/4))    } 

[p/2j    .  _  2(p+j)  2(P+j) 

=    22         ( n   {(sinCw/H))  +    (cos(w/4))  >(3.B.2.17) 

j  =  0      ^ 

To  show  inductively  that 

2n  2n    [p/2j  . 

(cos(u/4))    +  (sln(u/4))    =  I   a  .(cos  w)J ,      (3. B. 2.18) 

j  =  0   nJ 


observe  from  the  binomial  expansion  that 


2n  2n 

(cos(w/4))   +  (sin(u/4)) 


n-1  ,  2j  2j 

=  1=1  f^[(cos(a)/4))   +  (sin(co/4X)   ]  .      (3.B.2.19) 


n=0 


For  n  =  1, 


cos2(w/4)  +  sln2(to/ii)  =  1, 


and  for  n  =  2 


cos  (w/H)  +  sin  (w/4)  -  1-2cos2(oj/^)  +  2cos/4(w/^) 


=  (3+cos  w)/4. 
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2J  2J 

Assume  that  (cos  (co/4))   +  (sinCu/^))    has  the  form  (3. B. 2.18) 

for  j  =  1, . . .  ,n  .   Then 


2n+l  2n+l 

CcosCu/4))     +  (sin(w/4)) 


n    ,_   j/2  m 

=  1  -   Z  (n.1N)  S    a.  (cos  w)   ,    (3.3.2.20) 


j; 


m=0 


with  [n/2j  providing  the  maximum  power  of  cos  to  in  thi: 
expression. 

Applying  this  result  to  (3. B. 2.17)  gives 


W 
NT.  =   2   a.  cos  jw,   W 
1   J-0   J 


3P/4  , 


P  =  2,4,6,... 


(3.B.2.21) 


(3p-l)/'»  ,   P  --"  3,5,7, 


Placing  1\L  over  the  combined,  common  denominator  of  degree 
M'  provides  a  polynomial  of  degree 


'  (p2+5p-6)/45   p  =  2,5,6,9,10,13,1^, 


W  =  W+Mf  =  I 


(3.B.2.22) 


(p  +5p-4)/4,   p  =  3,^,7,8,11,12,... 


To  show  that  N!  of  (3.B.2.8)  is  equal  to  W  of 
(3.B.2.22),  it  is  necessary  to  examine  the  structure  of 
(3. A. 2. 27)  in  light  of  (3.B.2.9)  and  Theorem  III.A.l.   That 
is, 
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f,(w)  =  I      y.cos  j 
j=0  J 


lo 


N 

I   a  cos(nu/l|) 

=  QA(^,P)  ^ •  (3-B.2.23) 

I      B'cos  ma) 
m-U 

Multiplying  the  left  hand  summation  in  (3.B.2.23)  by  the 
denominator  of  the  right  hand  side  gives  a  series  in  cos  jco. 
Since  this  series  is  equal  to  a  series  in  cosCjw/^O,  it  is 
necessary  that  the  only  terms  with  non-zero  coefficients  in 
the  numerator  of  the  right  hand  side  of  (3-B.2.23)  have 
index  j  an  integer  multiple  of  *l ,  by  the  orthogonality  of 
the  cosine  series.   Hence  all  numerator  terms  for  n  not  an 
integer  multiple  of  k   must  cancel.   It  is  necessary,  then, 
to  be  concerned  only  with  those  terms  which  will  not  cancel. 

In  particular,  the  numerator  of  a  given  term  of 

2 

S    (p)    will   be 

P_ 
{p-nn  sinGo/^) }  (1-cos    u)    D0 
N, 


{p/2+n^+2pn1sin(w/iO}c 

Prom    (3. A. 2. 3)    and  the    derivation   of    (3. A. 2. 8)    it    is    clear 
that 

P  h  h  X3 

(1-cos    w)    /c      =    (1-sin    ui/l)       (1+cos    w/1)       (1-sln   u/4) 


\ 


x(l-cos    w/4) 
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where  1,  +  1  +  1_  +  lj.  =  3p  •   Since  it  is  known  that  all 
coefficients  must  vanish  except  those  indexed  with  integer 
multiples  of  4 ,  N,  may  be  considered  a  polynomial  in  cos  to 
of  degree  [(4+3p)/^J  .   Combining  this  information  with 
(3.B.2.9)  shows  that  the  degree  of  N. ,  when  placed  over  the 
common  denominator  for  the  entire  expression,  to  be 
[C4+3p)/4j+M'-l  which  is  equal  to  W  in  (3.B.2.22).   The 
details  of  analysis  for  S  (p),  v  =  3>^  and  5  lead  to  the 
same  result,  thus  completing  the  proof  of  Theorem  III.B.2. 

It  has  been  established  that  the  second  order 
interval  spectrum  of  an  E(^,p)  process  is  that  of  an 
ARMA(m,n)  process  with  upper  bounds  given  for  m  and  n. 
Some  computations  are  tabulated  in  Fig.  VIII. A. 11  which 
reflect  these  results. 

III.C.   THE  DEGREE  OF  THE  SECOND  ORDER  INTERVAL  SFECTRA 

In  Section  A  of  this  chapter.  Theorem  III. A. 2  stated 
that  the  second  order  interval  spectrum  of  the  E(k,p) 
process  can  be  expressed  as  the  ratio  of  two  finite  rational 
polynomials  in  cos  to  (3. A. 2. 28).   It  is  of  interest  to 
explore  the  implications  of  this  theorem. 

For  the  case  in  which  k  is  odd,  the  degree  of  the 
denominator  is  bounded  by 


M-  .    |f+p-> 


-  l  .  (3.C.D 
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This  can  be  seen  by  observing  that  f  )  represents  the 

total  number  of  distinct  terms  in  (3. A. 2. 2),  and  it  is  known 
from  Lemma  III.A.l  that  there  is  no  contribution  to  the 
denominator  from  the  set  R,  =  {p  ,0  ,0  ,  .  .  .  ,0}  . 

Again  for  k  odd,  the  numerator  has  degree  bounded  by 
N'  =  M'+p+[-p/kJ.   In  (3. A. 2. 16)  it  was  shown  that  each  set 
R,  could  be  expressed  as  the  ratio  of  polynomials  of  order 
N.+kr-p  and  N,  in  cos(co/k).   Theorem  III.  A.  2  guarantees 
that  these  polynomials  can  be  rewritten  as  polynomials  in 
cos  03  of  order  [  (N,  +kr-p)/k]  and  [N./kJ  .   From  the  construc- 
tion of  R  ,  it  can  be  seen  that  N,  =  k!/(n, !  .  .  .n,  ! )  where 
n.  represents  the  number  of  times  j  appears  in  R .  .   It 
is  easily  shown  that  M  is  an  integral  multiple  of  k  for 
all  t  as  defined  in  Lemma  III.A.l.   When  (3.  A.  2.16)  is  placed 
over  the  ensemble  common  denominator,  the  numerator  becomes 
a  polynomial  in  cos  w  of  order 

N*  =  L(Nt+kr-p)/kJ+(p-r)-LNt/k]+M' 

=  M'+p+L-p/kJ  (3-C.2) 

The  case  in  which  k  is  even  is  more  difficult.   A 
simple  formula  is  not,  in  general,  available.   The  procedure 
followed  in  the  exposition  of  Theorem  III.B.2  must  be 
followed.   In  (3.B.2.3)  it  was  noted  that  for  k  =  2n, 
cos(2Tr(j+n)/k)  =  -cos(2nj/k)  .   Further, 
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sin(2Tr(j+n)/k)  =  -sin(2irj/k)  .   Thus,  instead  of  k  distinct 
terms,  there  are  n  =  k/2  distinct  terms,  each  repeated  with 
opposite  sign.   For  example,  let  k  =  8  and  p  -  3«   Let 
L  =  (2,0,0,0,1,0,0,0).   Then  a,,  as  defined  in  (3. A. 2. 3), 
is 


o    (2tt+oj)        (IOtt+u) 
a,  =  p-2cos- —  g    ~  cos  g 


p-cos- rr^ 


Define  the  set  1/  (p)  to  be  the  set  of  all  non-negative 
vectors  of  length  n  satisfying  the  following  conditions: 

1.  The  elements  of  each  vector  are  arranged  in 
non-decreasing  order. 

2.  The  sum  of  the  elements  of  each  vector  plus  a 
non-negative  even  integer  is  equal  to  p. 

Each  vector  v   in  V    (p)  is  analogous  to  an  index  desig- 
nator set  R  .   For  example,  if  (1,1,3)  e  V  (9),  it  also 
represents  the  vectors  (1,3*1)  and  (3,131).   In  the 
notation  of  (3. A. 2. 3)3  these  vectors  represent  2h   values 
of  a.  : 

(1,1,3)  :   9±cos((2tt+u)/6)±cos((4ti+w)/6)±3cos((6t:+oj)/6) 
(1,3,1)  :   9±cos((2tt+gj)/6)±3cos(07t+w)/6)±cos((6tt  +  oj)/6) 
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(3,1,1) :   9±3cos((2tt+u))/6)±cos((4tt+co)/6)±cos((6tt+u)/6) 

Denote  the  elements  of  1/  (p)  by  v ,  ,  t  =  1 ,  .  .  .  ,  |  l/n(p)  |  . 
Here,  |A|  denotes  the  cardinality  of  the  set  A.   Then  the 
degree  of  the  denominator  of  the  interval  spectrum  is  no 
larger  than 

I^(P)I 
£     \\\-2n 

M'  =   ^ ^ (3.C.3) 

and  the  degree  of  the  numerator  is  bounded  by 


N'  =  M'+max{|(|vt|  -p)/k  +p-  |vt|/k|}  ,        (3.C.4) 


where  \v.\    represents  the  number  of  distinct  values  of  a^ 
which  are  derived  from  v    .      The  difference  between  ( 3  •  C  .  k ) 
and  (3.C2)  results  from  the  fact  that  \v.  \    is  not  necessarily 
an  integral  multiple  of  k.   If  v,    ■  (1,1,1)  e  l/3(3)5  then 
|  v.   |  =  8,  which  is  not  divisible  by  6. 

Figure  III.C.l  is  a  table  of  N'  and  M'  values  computed 
by  the  method  shown  in  this  section  for  various  values  of 
k  and  p.   Algebraic  computations,  discussed  in  Chapter  VIII 
have  confirmed  actual  values  to  be  in  agreement  with  the 
estimates  for  certain  specific  cases,  but  lower  values  are 
indicated  for  others. 
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k    2  3  4  5  6       7       b 

P 

2  0,1*  1,2*  1,2*  2,3*    2,3  3,4     3,4 

3  1,2*  2,4*  3,5*  6,3*    6,8    11,13   11,13 

4  1,3*  4,6  5,8*  13,16   13, 16   29,32   27,30 

5  2,4  6,9  8,11  24,28   23,27   65,69   56, 60 

6  2,5  8,12  11,15  41,45   36,40   131,136  115,122 

7  3,6  11,15  15,20  65,70   41,53  245,251 

8  3,7  14,19  19,25  98,104   74,80  489,497 

9  4,8  17,23  24,30  142,149  108,115 

10  4,9  21,27  29,36  199,207  142,150 


Figure  III.C.l   Upper  bound  estimates  for  the  orders  of 
the  polynomials  representing  E(k,p)  second-order  interval 
spectra.   The  first  element  of  each  pair  is  degree  of  the 
denominator.   The  second  is  the  degree  of  the  numerator. 
Those  processes  marked  with  an  asterisk  have  been  computed 
and  are  shown  in  Figure  VIII. C. 5.   Serial  correlation 
analysis  of  the  E(3,5)  process  indicate  the  actual  degree 
is  (6,8)  rather  than  the  indicated  (6,9).   See  Section  VIII. E 
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III.D.   COMMENTS  ON  THE  MIXED  AUTOREGRESSIVE/MOVING 
AVERAGE  SPECTRUM 

It  has  been  stated  (Theorem  III. A. 2)  that  the  second  order 

E(k,p)  spectrum  has  the  form  of  a  mixed  autoregressive/moving 

average  process  of  degree  m  and  n  respectively.   An  important 

property  of  a  stationary  mixed  autoregressive/moving  average 

process  is  the  relationship  of  the  serial  correlations. 

A  typical  finite  ARMA(m,n)  process  is  defined  by 


z.+a.z,  ,  +  ..,+a  z,    =  e,+bne,  _  +  ...+b  e,         (3.D.1) 

t   1  t-1      m  t-m    t   1  t-1      n  t~n 


where  z,  is  the  observed  value  of  the  process  at  time  t  and 
{e,  }  is  a  sequence  of  independent  identically  distributed 
random  variables  with  zero  mean.  .With  m  >  n  the  serial 
correlations  are  given  by  (Box  and  Jenkins,  1970) 


pk  =  alpk-l+-'-+ampk-m>   k  >  n>  (3'D'2) 


For  the  first  n  lags,  p  ,...,p   depend  jointly  on  a . , 
j  =  l,...,m,  and  b.,  i  =  l,...,n. 

Since  the  second  order  spectrum  of  a  stationary  inter- 
val process  is  an  unique,  invertable  transformation  of  the 
serial  correlations,  it  follows  that  the  serial  correlations 
of  an  E(k,p)  process  have  the  above  property .  Thus,  those 
sections  of  Box  and  Jenkins  dealing  with  mode].  Identifica- 
tion can  be  applied  directly  to  a  data  set  which  is  suspected 
of  having  emanated  from  an  E(k,p)  process.   Figure  III.C.l 
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can  be  used  in  this  respect  to  assist  in  determining  which 
E(kjp)  process  might  provide  the  best  model. 

Estimation  properties  for  k,  p  and  A  of  the  E(k,p) 
process  are  unknown.   As  a  result,  the  statistician  must 
apply  at  once  the  methodology  of  Chapter  VIII  of  Cox  and 
Lewis  (1966)  which  bases  the  estimation  of  p  on  the  variance- 
time  curve  and  the  additivity  of  the  counting  process  in  a 
superposition;  the  results  of  this  chapter  regarding  Inter- 
val series  analysis,  and  the  results  of  Chapter  VII  of  this 
thesis  which  relate  the  marginal  interval  density  to  the 
number  and  nature  of  the  component  processes . 

III.E.   THE  SECOND  ORDER  COUNT  SPECTRUM  FOR  THE 
E(k,p)  PROCESS 

In  Chapter  II,  Subsection  A. 2,  the  second  order  spectrum 
of  counts  of  a  stationary  point  process  is  introduced 
following  Cox  and  Lewis  (1966,  Ch .  4).   In  subsection 
II. B. 3,  the  extension  to  the  count  spectrum  of  the  super- 
position of  independent  stationary  point  processes  was 
given  (Cox  and  Lewis,  1966,  Ch.  8). 

For  the  sake  of  completeness,  a  sketch  of  those  results 
is  presented  here,  and  applied  to  the  Erlang  superposition. 

Recalling  (2. A. 2. 5)  and  (2. A. 2. 6),  the  asynchronous 
intensity  of  a  stationary  (regular)  process  is  m  =  1/E[X], 
where  X  denotes  the  length  of  an  interval  following  an 
arbitrary  event,  and  the  synchronous  intensity  is  mf(t). 
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The  intensity  function  of  the  synchronous  counting 
process  generated  by  the  superposition  of  p  independent 
renewal  processes  is 


m£p)(x)  =  mf(x)  +  (p-l)m   .  (3-E.l) 


The  count  spectrum  of  a  stationary  stochastic  process 
is 


g+(w)  =  m{l+   /  (mf(u)-m)e  laJudu}/iT  u,   w  >  0 


which  has  the  alternative  form3  due  to  Cox  and  Lewis 


g+(w)  =  m{l+mf(ico)+mf(-io.O}/7Ty,  (3.E.2) 

where  mf(s)  is  the  ordinary  one-sided  Laplace  transform  of 
nu(t).   From  (2. A.  2. 6),  it  is  clear  that  for  a  renewal 
process 


* 

m_(s)  =   1  TJ     ,  (3.E.3) 

f      (1-f  (s)} 

x 

where  f(t)  is  the  renewal  density  and  f  (s)  is  its  Laplace 

transform.   Then  for  the  superposition  of  renewal  processes, 
(3.E.2)  can  be  expressed  as 
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JPh,^     _/P\     f  1+f     (lh))f     (-103)  1 

+  Vry;  (i(o)-f    (-iw)+f    (lw)f    (-idj ) 


=   pg+(") 


(3.E.U) 


The    spectrum  of   the   E(k,p)    counting  process    is   given 
by    (3.E.4)    v/ith   f    (s)    =    (A/(A+s))k,    so   that 


M»>  <&)< 


VkW 


5      D   k      2k 
(AN-w    )    -A 


(A2  +  u)2)-Ak{(A  +  iw)k+(A-ico)k}  +  A2k' 


,1 


k    ..  ,  /    2x3-1 

=i^;Va2/ 


k    /,,N/,.2\'I~1        k/2 


4©fe 


"Vi^^H? 


J/,  2 


.1-1 


(3.E.5) 


Evaluating    (3-E.5)    at    0   gives 


g+(0+)    =  pX/ClTir)    . 


(3-E.6) 
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IV.   SECOND  ORDER  SPECTRAL  ANALYSIS 
OF  THE  H(k,p;q,A)  PROCESS 

The  analysis  of  the  last  chapter  dealt  with  renewal 
processes  with  interevent  times  governed  by  the  Erlang 
distribution.   One  important  property  of  the  Erlang  distri- 
bution is  that  it  has  increasing  hazard  rate.   That  is,  if 
X  has  increasing  hazard  rate,  then  -rr-{f  (t)/R(t ) }  is  an 
increasing  function  of  t.   See  Barlow  and  Prochan  (1965) 
for  a  more  detailed  discussion  of  the  hazard  property. 
Enns  (1970)  showed  that  if  p  iid  renewal  processes  are 
superposed,  and  the  component  processes  have  monotone  hazard 
rate,  then  an  arbitrary  interval  of  the  superposition 
process  has  monotone  hazard  rate. 

It  is  of  interest,  therefore,  in  case  one  observed  a 
superposition  of  renewal  processes  in  which  the  times 
between  superposed  events  had  a  decreasing  hazard  rate,  to 
examine  a  class  of  distributions  with  decreasing  hazard 
rate  for  the  intervals  of  the  component  renewal  process . 
One  such  distribution  is  the  hyperexponential  which  has  the 
form  of  a  convex  combination  of  exponential  distributions. 
The  hyperexponential  distribution  may  be  thought  of  as  a 
set  of  exponentially  distributed  random  variables,  the 
choice  of  which  is  governed  by  a  discrete  probability  law. 
(A  more  general  definition  has  the  parameter  of  the  expo- 
nential distribution  selected  from  an  arbitrary  probability 
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distribution  on  the  positive  real  line.   The  definition 
given  for  this  research  project  is  a  special  case  of  the 
more  general  definition.)   The  tractability  of  this  distri- 
butional form  in  obtaining  an  interval  spectrum  for  the 
superposition  process  comes  from  the  fact  that  the  Laplace 
transform  of  the  pdf,  as  in  the  Erlang  case,  is  a  ratio  of 
rational  functions  in  s . 

Section  A  is  devoted  to  development  of  the  interval 
spectrum  of  the  hyperexponential  superposition  process  using 
the  method  described  in  Chapter  III. 

In  Section  B,  the  interval  spectrum  for  the  H(  2 , 2  ;c[,  X) 
is  worked  out  in  detail. 

The  count  spectrum  of  the  H(2,p;q,A_)  process  is  shown 
in  Section  C.   The  complexity  of  the  form  of  the  Laplace 
transform  of  the  hyperexponential  pdf  precludes  in  depth 
analysis  of  either  spectral  form  presented  in  this  chapter. 

IV. A.   THE  INTERVAL  SPECTRUM  OF  THE  H(k,p;q_,A)  PROCESS 

Following  the  methodology  of  Chapter  III,  Section  A, 
the  interval  spectrum  will  be  determined  from  the  procedure 


4>  (z,s)  •*•  (J>(z,t)  •*  4>p(z,t)  ->   d>  lpj(z,s),     (4.A.1) 


where  <J>(z,t)  Is  the  generating  function  of  counts  for  the 
asynchronous  component  process,  and  <J>  (z,s)  is  Its  ordinary 
Laplace  transform.   The  symbols  L,  and  L   denote  the 
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Laplace  transformation  and  the  inverse  Laplace 
transformation j  respectively. 

Let  N  (t)  be  a  component  asynchronous  counting  process. 
Denote  the  survivor  function  of  the  interevent  times  in 
the  component  renewal  processes  by 

k 
R(t)  =   E   q.exp{-A  t}5  (4.  A.  2) 

j  =  l   J       J 

k       k 
where  q.  >  0,  A  .  >  0  ,  j  =  l,...3k3  and,   E  q.  =   E  A.  =  1. 

Then  the  superposition  of  the  p  lid  processes  is  an  H(k,p;q,A_) 

process . 

The   Laplace    transform  of   the    component   interevent  pdf 

is 


f*(s)    =    _    /    dRltle-st 
o        dt 


=      Eq.A.exp{-(A .+s)t}dt 


=      E(q    A    )/(s+A.).  (4. A. 3) 

j=l   J    J  J 


From    (3. A. 1.9) 


*,      Q^    _    sE[X]{l-zf*(s)}+(z-l){l-f*(s)} 
s^E[X]{l-zf    (s)} 


\J  =  lAJ/\       J=l   S  +  AJ/  <*». A. 4) 
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Now,  let 


k 
U(s)  =   n  (s+X.) 
0=1    J 


and 


H(s)  =   Z  q  X.   II  (s+Xj,  (H.  A,  5) 

j  =  l  J  J  r^j 

so  that  (4. A. 3)  can  be  rewritten  as 


f*(s)  =  H(s)/U(s).  (4. A. 6) 


Using  (4. A. 6) s  the  Laplace  transform  of  the  generating 
function  of  counts,  (4. A. 4)  can  be  written 


*,    ,    sE[X]{U(s)-zH(s)}+(s-l){U(s)-H(s)} 
(f)  (.  Z  j  s  j  -  p 

s  E[X]{U(s)-zH(s)} 


=  A(s)/B(s),  (4.  A. 7) 

where  A(s)  and  B(s)  are  defined  in  the  obvious  way. 
Then  Gardner  and  Barnes  (19*12)  give 


L  1(4>  (z,s))  =  4>(z,t) 


M 

=   I  A(s  )exp{s  t}/B'(s  )  ,      (*».A.8) 
n    m   ^   m       m 
m=l 
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where  the  values  s  ,  m  =  1.....M.  are  the  distinct  poles  of 

m 

X 

4>  (z,s),  provided  there  are  first  order  poles  only.   No 
effort  has  been  made  to  determine  if,  in  general,  <f>  (z,s) 
has  only  first  order  poles.   This  has  been  the  case  for 
those  specific  processes  considered.   The  prime  denotes  the 
first  derivative  with  respect  tos. 

The  inversion  of  $    (z,s)  is  not  a  trivial  matter,  even 
when  provided  with  the  general  inversion  formula.   A  more 
manageable  approach  is  presented  in  Chapter  VI,  wherein  the 
H(k,p;q,_X)  process  is  represented  as  a  semi-Markov  generated 
point  process  with  equivalent  probabilistic  structure. 
Further  analysis  along  current  lines  will,  therefore,  be 
restricted  to  the  H(2,2;c},X_)  process. 

IV. B.   THE  INTERVAL  SPECTRUM  OF  TEE  H(2,2;q,X)  PROCESS 

The  component  process  residual  life  distribution  for 
time  between  events  is,  from  (4. A. 2) 


R(x)  =  q1exp{-X1x}+q2exp{-X2x} 


with  corresponding  Laplace  transform 


f*(s)  =  [s(q1X1+q2X2)+X1X2]/(s2+s+X1A2),      (4 .B.l) 


and  expectation 


E[X]  =  (q  X2+q  X1)/(X  X2).  (4.B.2) 
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Evaluating  the  Laplace  transform  of  the  count  generating 
function  (lJ.A.7)  in  light  of  (4. A. 6),  (4.B.1)  and  (4.B.2) 
requires  tedious  but  straightforward  algebra.   The  result 
is 


*        s+l-z(q  X^q  X2)+A  X2(z-l)(q  A2+q  X  ) 

<f>  (z,s)  =  g ~"   " ~'"~  ■-——  -- 


s  +s{l-z(q1X1+q2X2)}+A1A2(l-z) 


s-a+XnX:>(z-l)/(q.X„  +  q_Xn  ) 

'  (s-a)U-b)         »        (^-B-3) 


where 


a  =  z(q1X2+q2X1)-l, 


3  =   a2-4A1X2(l-z)   , 


a  =  (a+B)/2  , 


b  =  Co-8)/2  .  (4.B.4) 


Inverting  <J>  (z,s)  using  (4.  A.  6)  results  in 


4>(z,t)  =  [(2y-a+B)exp{at}-(2y-a-6)exp{bt}]/2  s     (4.B.5) 


where 


Y=  X1X2(z-l)/(q1X2+q2X1)  .  (4.B.6) 
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Continuing  with  the  procedure  outlined  in  C4.A.1) 


2  2  _1  2 

<T(z,t)  =  (23  )   [(2Y-a+e)  exp{2at} 


2 
+  (2y-a-3)  exp{2bt} 


-  8(y  -ya+X1X2(l-z)exp{a}]  ,        (4.B.7) 


with  a,  8,  y,  a  and  b  as  in  (4.B.4)  and  (4.B.6). 

Since  a,  B>  Yj  a  and  b  are  independent  of  t,  the  Laplace 
transform  of  (4.B.7)  is  immediate: 


-1         2 
£  vt/(z,s)  =  (23")   [(2Y-a+6)  /(s-2a) 


«(2),_  _,  _  ,_<:. 


2 
+  (2y-o-0)  /(s-2b) 


-  8{Y2-Ya+4X1X2(l-z)}/(s-a)]  .    (4.B.8) 


Recalling  from  (3.A.*0  that  the  interval  spectral 
density  of  a  stationary  point  process  is  given  by 

f  (uO  =  4.*(e^t0+)  +  (i>*(e-lh)t0+)    s  (Z|>B<9) 

(2(f)  (0,0+)-E[X])tt 

*  (2) 
the  next  step  is  to  evaluate  4>    (z,s)  at  s  =  0+,  so  that 


13.ll 


4>*(2)(z,0+)  ■  -2{a2-2aY+y2+X1X2(l-z)}/{a(a2-62)} 


(z-l)2(A-X1X2)2+A[z2(z2-2A+2A1X2)+z(2A-3X1X2)+X1X2] 


2A2X1X2[(z-l)2-Az(z-l)] 


(4.B.10) 


where 


A  =  q  X2+q  X1  =  l-q-A-j-qpAp  • 


(4.B.11) 


In  Equation  (4.B.10),  let 


R  =  A4-2A3+A2(1+2X1X2)+2AX1X2+(X1X2)2   , 


3  r2 


S  =  2AJ-A  (2-3X,X„)+^AXnX0-2(X,X^)  , 

Id  id  x   d 


T  =  A  (1+X1X2)-2AX1X2-2(X1X2)  , 


U  =  2A  X1X2(1-A) , 


V  -  2A'A  A2(A-2), 


and 


W  =  2ACX1X2  , 


(H.B.12) 


so  that 
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Uz  +Vz+W 


Now,  making  the  appropriate  substitutions  for  z  in 
(ij.B.13),  and  recalling  (4.B.2),  (4.B.9)  and  (4.B.11), 
the  interval  spectrum  of  the  superposition  process  may  be 
written  as 


-(2),  v    n  (RW+UT)cos  2to+{V(R+T)  +  (U+V/)S}cos  co+RU+SV+WT 
f     (03  J  -  Q p p p 

UWcos  2u+V(U+T.'/)cos  u+U  +V  +W 


(ij.B.14) 


where 


Q=  [A2A1X2]/[2X1.\2-2AX1X2+A2(1-X1X2)-A3)  .    (4.B.15) 


Beyond  the  observation  that  the  interval  spectrum  of 
the  H(2,2;o5_X)  process  is  that  of  an  ARMA(2,2)  process,  very 
little  insight  is  gained  from  this  method  of  spectral 
computation.   Answers  to  such  questions  as  the  nature  of 
the  serial  correlation  sequence  as  a  function  of  q  and  X_, 
the  effect  cf  increased  values  of  k  or  p,  etc.,  are  deeply 
burried  in  the  simplifying  notation.   Further  analysis 
along  this  line  appears  futile. 

IV.  C.   THE  COUNT  SPECTRUM  OF  THE  H(2,p;a,X)  PROCESS 

Using  the  procedure  of  Section  III.E,  the  second  order 
spectrum  of  the  counting  process  is  more  easily  obtained. 


IV 


For  simplicity,  attention  is  restricted  to  the  H(2,p;g_,X_) 
process . 

Equations  (3.E.6),  (4.B.1)  and  (4.B.2)  yield  the 
follov.'ing  expression  for  the  spectral  density  of  this 
counting  process: 


g{p)(aj)  =  pA{A2-2(l-A1X2)  +  co2}/{(A2+cu2)(X1X2)}  ,    (4.C.1) 


v;here  A  is  as  defined  in  the  set  of  Equations  (4.B.11) 


117 


V.   SEMI-MARKOV  GENERATED  POINT  PROCESSES 

A  class  of  processes  which  are  of  direct  application  to 
this  research  is  that  of  events  marking  transitions  in  a 
semi-Markov  process.   These  processes  are  studied  in  this 
chapter.   Chapter  VI  is  devoted  to  describing  the  Erlang 
and  hyperexpcnential  superposition  processes  as  semi-Markov 
generated  point  processes,  and  applying  the  results  of  this 
chapter. 

In  Section  A  we  give  the  definition  of  a  semi -Markov 
process  and  univariate  semi-Markov  generated  point  process, 
with  a  brief  summary  of  previous  work  with  regard  to  this 
model.   Section  B  contains  the  development  of  the  interval 
covariance  function  and  second  order  interval  spectrum  of 
a  semi-Markov  generated  point  process.   In  Section  C  the 
results  of  Section  B  are  expanded  to  the  interval  trivari- 
ance  and  bispectrum  of  intervals,  with  an  indication  of 
the  method  of  extension  to  higher  order  multivariance  and 
spectra . 

The  interest  in  the  higher  order  joint  moments  and 
spectra  comes  from  the  fact  that  the  intervals  in  a  semi- 
Markov  generated  point  process  are  non-normal;  thus  the 
process  is  not  completely  specified  by  second  order  joint 
moments.   In  examining  the  higher  order  moments  we  hope  to 
give  a  more  complete  description  of  the  process. 
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V.A.   THE  SEMI-MARKOV  GENERATED  POINT  PROCESS  DEFINED 

A  very  general  definition  formulated  by  Smith  (1955)  of 

2 

a  semi-Markov  process  has  n  independent,  non-negative 

random  variables,  S  .,  i,j  =  l,...,n,  with  distribution 
functions  P  .(v),  which  are  sampled  in  accordance  v,Tith  a 
Markov  chain  with  transition  matrix  T  =  {t  .}.   At  a 
transition  time,  if  the  Markov  chain  makes  a  transition  to 
state  i,  the  next  transition  is  to  j  with  probability  t. . 
and  the  time  between  transitions  is  distributed  in 
accordance  with  F. . (v). 

If  each  transition  of  the  Markov  chain  is  recorded  as 
an  event  in  time,  the  record  of  events  is  a  semi-Markov 
generated  point  process. 

In  Smith's  work,  and  most  subsequent   work,  the  semi- 
Markov  process  is  either  a  model  for  a  state  process,  the 
sample  functions  taking  on  n  levels,  or  a  multivariate 
point  process  (Cox  and  Lewis,  1972),  i.e.,  a  point  process 
with  n  event  types  called  a  Markov  renewal  process.   Here, 
it  is  used  as  the  source  of  an  interval  sequence  in  a  uni- 
variate point  process  by  superposing  the  marginal  processes. 
Cherry  (1972)  developed  the  mathematical  structure  of  the 
superposition  of  two  Markov  renewal  processes  as  multivariate 
point  processes. 

As  the  mode]  of  a  multivariate  point  process,  it  is 
apparent  that  the  sequence  of  times  between  successive 
arrivals  into  state  i  In  a  semi-Markov  process  forms  a 
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renewal  process  for  each  state  i  =  l,.,.,n.   The  distinctive 
feature  is  that  the  n  renewal  processes  thus  formed  are 
dependent.   The  semi-Markov  generated  point  process  is, 
then,  a  superposition  of  dependent  renewal  processes.   In 
general,  n  Independent  renewal  processes  form  a  semi-Markov 
process  only  if  the  intervals  are  exponentially  distributed. 
It  will  be  shown  in  Chapter  VI,  however,  that  it  is  possible 
to  construct  a  semi-Markov  generated  point  process  for  which 
the  probabilistic  structure  of  the  (output)  sequence  of 
events  is  the  same  as  that  of  the  superposition  of  finitely 
many  Erlang  or  Hyperexponential  independent  renewal 
processes . 

For  the  purpose  of  this  analysis,  assume  the  distribu- 
tions P  . (v)  are  absolutely  continuous  and  have  an  associated 
density  function  f . . (v) .   Using  bold  face  type  to  indicate 
matrices j  denote  by  F(v)  =  (f..(v)}  the  matrix  of  transition 
time  densities.   Further,  assume  the  non-central  moments 

(r)       r  frO 

V  =  E[S  .]  exist  for  r  <  R,  and  let  E   =  {u..  }  be  the 

matrix  of  r-th  moments. 

It  is  worth  noting  at  this  point  that  in  much  of  what 
follows,  the  non-central  moments  of  the  random  variables 
{S  . }  are  all  that  is  required,  hence  the  assumption  of 
absolute  continuity  is  unnecessarily  strong.   The  reasons 
for  the  supposition  are  to  simplify  the  exposition,  to 
ensure  that  the  point  process  will  be  regular,  and  finally, 
that  in  the  applications  proposed  the  assumption  Is  satisfied, 
thus  negating  a  requirement  for  a  more  rigorous  treatment  . 
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Let  X  be  the  random  variable  associated  with  the  rn-th 
m 

transition  of  the  Markov  chain,  for  m  =  0,±1,±2,....   Thus 

if  the  m-th  transition  is  from  state  1  to  state  j  ,  X  =  S,, 

m    ij 

That  is,  the  residence,  or  sojourn  time  in  state  i,  condi- 
tioned on  eventual  transition  to  state  j .   Assuming  the 

origin  of  the  sequence  {X  }  was  chosen  arbitrarily,  and  all 

m 

states  of  the  chain  are  ergodic  (see  Feller,  1968,  or 

Kemeny  and  Snell,  I960),  then  {X  }  is  a  stationary  sequence 

of  intervals.   This  fact  is  most  easily  seen  by  observing 

that  the  transition  process  is  stationary,  so  that  the 

probability  of  entering  a  particular  state  following  the 

k-th  event  approaches  a  constant  as  k  goes  to  infinity, 

regardless  of  the  starting  conditions.   Kence,  the  finite 

dimensional  distributions  of  {X  }  are  translation  invariant 

m 

with  respect  to  the  index  sequence. 

Example  V.A.I  A    Two   State    Univariate   Semi-Markov 
Generated  Point   Process.       Cox  and  Lewis  (1966,  p.  19*0, 
propose  the  following  example  of  a  univariate  semi-Markov 
point  process: 


T  = 


1-a. 


1-a. 


a, 


0  £  a1,a2  <  1, 


F(t) 


fx(t)    f3(t) 


f2(t)     f2(t) 


,   t  >  0 


i  :'i 


This  model  might  describe  the  failure  pattern  for  a  machine 

which  receives  its  spare  parts  from  two  sources,  each  source 

having  its  own  failure  time  distribution.   When  a   =  a   =  0, 

an  alternating  renewal  process  is  generated. 

V.A.I.   The  Second  Order  Count  Spectrum  of  a  Semi-Markov 
Generated  Point  Process 

Rudemo  (1973)  analyzed  in  detail  a  special  case  of 

a  semi-Markov  generated  point  process.   In  the  notation  of 

this  chapter, 


C  A.  .expf-A^.v},   i  ■/   j 


Vv) 


v 


0  , 


(5. A. 1.1) 


and 


'ij 


A  .  .  /  I   A  .  .   j 


0  , 


i  ¥■    J 


i  =  j 


(5. A. 1.2) 


In  addition,  define  the  matrix,  Q,  as  the  matrix  of  elements 


r 


'«  -\ 


'ij  ' 


-  I    X 


i/j   J 


i  /  J, 


i  -  j. 


(5.  A.  1.3) 
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The  interpretation  of  q  .  is  that 


q,  ,  =  lim   {P.  .  (dt)  -  P.  . (0)}/dt 
J    dt-*0    J         J 

where  P  .(t)  =  Pr{system  is  in  state  j  at  t|state  i  at  0}. 
That  is,  q..  is  the  intensity  of  a  transition  to  state  j 
given  the  system  is  in  state  i. 

Assuming  the  matrix  T  is  irreducible  and  aperiodic 
it  has  stationary  vector,  it,  such  that 


tttT  =  ttt   .  (5.  A.  1.4) 


Similarly,  define  p.,  the  j-th  element  of  p_,  to  be  the  limit 
as  time  goes  to  infinity  of  the  probability  that  the  system 
is  in  state  j;  i.e.,  the  probability  that  the  system  is  in 
state  j  at  an  arbitrary  time.   Then, 


-1 
Pj  =  {q   (  Z    (l/qnn))    •  (5. A. 1.5) 


Let  the  matrix  P(t)  =  {p..(t)}.   Then  as  t  goes  to 
infinity,  P  .  (t)  •*■  p.,  and  P(°°)  is  a  matrix  for  which  each 


row  is  p_T.   Also,  P  '  (0)  =  Q,  and 


p'jU)  -  I    Pln(t)qnJ  ,  (5.A.1.6) 

where  the  "prime"  is  used  to  denote  the  first  derivative. 
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Finally,  Rudemo  has  determined  that  the  asynchronous 
intensity  of  an  event  at  an  arbitrary  time  is 

m  =  pTq  =  ijTP(o°)q  ,  (5. A. 1.7) 

and  the  asynchronous  intensity  is 


mf(t)  =  nTP(tk  ,  (5. A. 1.8) 


where  the  vector  q_  =  {q.  .},  and  ij  indicates  the  transpose 
Of  jr  . 

Having  defined  and  characterized  the  basic  model, 
Rudemo  developed  a  representation  for  the  second  order  count 
spectrum  of  the  process.   Following  Cox  and  Lewis  (1966, 
Ch.  4),  and  as  given  by  (2. A. 2. 13), 

g+(u)  =  ^{l+mf(iu)+mf(-iw)},   a  >  0 ,         (5. A. 1.9) 


where 


mf(s)  =   /  e  st(mf(t)  )   dt 
o 


From  (5.  A. 1.7)  and  (9-  A.  1.8) 


m*(s)  -  /  e  StET(P(t)-P(«0)a  dt 

o 


1?'J 


mf(s)    =    ttTP    (s)q    ,  (5. A. 1.10) 


v:here 


P*(s)    =      /   e"st(P(t)    -    P(»))dt 


Some    simple    calculations   will   verify   that    P(°°)Q    =    0, 
so   from    (5 -A. 1. 6) 


giving 


!_{P(t)-P(»)}   =    {P(t)-P(-)}Q,  (5.A.1.11) 


*  -1 

P    (S)    =    {l_P(co)}(ls_Q)       .  (5. A. 1.12) 


Using    (5. A. 1.7),    (5. A. 1.10)    and    (5.A.1.12)    in    (5. A. 1.9) 
yields 


g+(0j)     =     IT{P(»)  +  (I-P(co))[(Itdi_Q)         +(-Icoi-Q)         ]}q.  (5- A.  1.13) 


Two  points  of  interest  with  regard  to  Rudemo's  work 
as  related  to  this  thesis  are  worth  noting  here.   First, 
Rudeno's  definition  of  a  semi-Markov  generated  point  process 
is  actually  somewhat  more  general  than  given  here  in  that  he 
permits  a  subset  of  states  for  which  transitions  are  not 
recorded  in  the  point  process.   This  is  similar  to  the 
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methodology  in  Chapter  VI  below  wherein  some  states  are 
deleted  from  the  state  space  representation  in  order  to 
reduce  the  size  of  the  matrices. 

Secondly,  the  computational  procedures  presented 
in  Subsections  VIII. B.l  and  VIII. B. 2  below  for  finding  the 
inverse  of  a  matrix  (Iu-T)  can  be  applied  to  (5. A. 1.13) 
if  a  numerical  representation  of  the  second  order  count 
spectrum  is  desired. 

V.B.   SECOND  ORDER  INTERVAL  PROPERTIES  OP  THE  SEMI -MARKOV 
GENERATED  POINT  PROCESS 

Let  T  be  an  nxn  stochastic  matrix  with  stationary 

vector  as  in  (5. A. 1.4).   Each  transition  is  recorded 

according  to  its  time  of  occurrence,  with  times  between 

transitions  governed  by  F(u),  the  matrix  of  transition  time 

densities.   Let  X.  represent  the  interval  following  the 

J 

j-th  event,  with  an  arbitrary  interval  denoted  either  X 

or  X  ,  and  with  S.,  the  time  to  transition  from  state  i 
o'  lk 

(r) 
to  state  k  in  a  single  step.   Let  E   =  {u..  }  be  the  matrix 

r     ij 

of  r-th  moments  for  r  =  1,2,3,...,R. 

Define  two  new  matrices: 

G(u)  =  {t  .f  . (u)}  represents  a  matrix  of  transition 

densities  weighted  by  the  Markov  probability  of  the 

transition; 

M   =  {tJ.\iJ]}    represents  a  matrix  of  r-th  transition 
r     ij  ij 

moments  weighted  by  the  Markov  probability  of  the  transition 
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The  following  results  may  now  be  established: 

Lemma  V.B.I:   The  arbitrary  interval,  X,  is  governed 
by  the  pdf 


f  (u)  -  jfGdOl  (5.B.1) 


where  1  represents  an  n-vector  of  Vs.   Thus  fv(u)  is  a 
convex  linear  combination  of  the  f..(u)'s. 

CO  n 

Define   T      to   be   the    limit    as   j    -*■  «   of   T    .      Then  we 
have 

Lemma  V.B. 2 : 


E[X]    =    tLTM11    ,  (5.B.2) 

*r  oo 

Var[X]    =   ttt(M2-M1T    M    )1   ,  (5.B.3) 

From  Lemmas  V.B.I  and  V.B. 2  we  have 
Theorem  V.B.I: 


■5 


(5.B.H) 


Cov(Xt,Xt+.)  =  tL'M1(Tj   -T  )M11,   j  =  1,2, 


and 
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Theorem  V.B.2:   The  spectral  density  of  the  interval 
process  is 


f+(u>)  =  TL^{M2+M1[(IeiaJ-T)~1+(Ie~iw-T)  ^f^n/a2,     (5.B.5) 

0   <  U)   <   IT, 


where 


a2  =  Var[X]. 


Proof  of  Lemma  V.B.I:   Let  v  be  the  state  of  the 

process  following  an  arbitrary  event.   Pr{v  =  i}  =  tt  .  ,  where 

ir.  is  the  i-th  element  of  it.   The  probability  that  the  nexl 
i  — 

event  marks  a  transition  to  state  j  is  t...   Thus 

ij 

Pr{X  =S .  . }  =  TT.t.,.  with  conditional  density  f..(u).   The 
o  ij     i  ij  ij 

unconditional  density  is 


n         n 
fn(u)  =   Z  Pr(v=i)  I   t,.f,.(u) 
u      i=l       j=l  1J  1J 


=  tttG(u)1  .  (5.B.6) 


This  completes  the  proof  of  Lemma  V.B.I. 

Proof  of  Lemma  2:   The  expectation  of  X  is  finite  since 
it  may  be  no  larger  than  max  {y.,},  which  is  finite  by 
assumption.   Thus  interchange  of  order  in  the  forma] 
definition  using  (5.B.6)  yields 
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E[X]    ■     /  uf    (u)du 
o 


n  n  oo 

=      I    Pr(v  =  i)      Z    t    .      /   uf    .  (u)du 

1=1  j-1   1J    o  1J 

n  n 


■      Z   Pr(v»i)      Z   t. .u 

i=l  j  =  l   1J    XJ 


=   vj\!   ,  (5.B.7) 


which  agrees  with  (5.3.2) 
Similarly , 


2      T 
E[X  ]  =  tt_  M „_]_  j  hence 


Var[Xo]  =  2LT{M2-M10  l")M  H  .  (5.B.8) 


Note  that  _]_  jt  is  a  nxn  matrix  each  row  of  which  is  identical 

with  tT.   Feller  (1968,  Ch.  15)  shows  that  as  j  tends  to 

i         t  t    °° 
infinity  T   tends  toj_TT_  -  T  ,  under  the  assumptions  of 

this  chapter.   Thus 


Var[X  ]  =  2LT(M2"M1T°°M1)1 


This  completes  the  proof  of  Lemma  V.B.2. 


Proof  of  Theorem  V.B.I:   Since  {X,}  is  a  stationary 
sequence,  write  for  j  >  1 
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Cov(Xt,X   . )  =  y(j)  =  E[XqX  ]-E[X]2 


Applying  the  Chapman-Kolmogorov  forward  equation  (see  for 
example  Cox  and  Miller,  1965)  the  conditional  expectation 
of  XoX.  is 

E[X  X.|7=S  .]=  u  .   I  tH   j   E  t.„y.,  ,     (5.B.9) 
o  j  '  o  skJ   Ksk  ._..  ki     .  ,  xl   xl    ' 

where  t,  .   represents  the  probability  that  the  state  of  the 
ki 

system  at  step  p  is  i  given  that  the  state  at  step  0  was 
k,  i.e.,  the  p-th  stage  transition  probability.   Note  that 
TP  =  {tf?5}  (Feller,  1968,  Ch.  15). 
Unconditioning  (5.B.9), 


n   n 

E[X  X.]  =  I         E  Pr(X=S  .  )E[X  X.|X=S  .  ] 
0  J     s=i  k=i       sk     °  J     sk 


n     n         n   (._  1}   n 
=   E  n    Z   t   ,  y  ,   E  t.  i  E  t,  -y .  « 

B-l  S  k-1  Sk  Sk  1-1  kl      1=1     ±l    ll 


=  1TM1TJ  1M11  .  (5.B.10) 


Thus, 


2 

y(j)  =  itm1tj~1m11-(tLtm1i) 


=   tLtM1(TJ    1-T°°)M11   ,  (5.B.11) 
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which  corresponds  to  (5.B.4)  of  Theorem  V.B.I,  thus 
completing  the  proof  of  Theorem  V.B.I. 

Proof  of  Theorem  V.B.2:   Where  it  exists,  the  interval 
spectral  density  is  defined  by 


f.(w)  =  U+(2/a2)   Z  y(j)cos  j«}/ir, 

3=1 


(l+(l/o2)      I   ttTM    (Tj-1-TCC)M      (ela3j+e"iuj)}/u3 
3=1 


0  <  u  <  tt  ,  (5.B.12) 


with  i  =  v/^T  . 

CO 

Let  C(z)  =   £  y(3)z   denote  the  serial  covariance 

3=1 

generating  function.   If   E  y(j)  <  »,  then  C(z)  <  °°, 

3=1 

0    |  z  |  <_  1 .   We  first  show  that  the  covariance  sequence  is 

00 

summable,  and  that  lim  C(z)  =  I    y(J)-   Then,  we  show  that 

1     _i         z-*-l-        3=1 
(Ie  -T)  x   exists  form/  2  j  tt  ,  j  =  0,±1,±2,.... 

The  basis  for  the  summability  of  the  covariance  sequence 

is  from  Kemeny  and  Snell  (I960,  p.  71)..  where  it  is  shown 

that  there  are  constants  b  and  r,  0  <  r  <  1,  such  that 

|t^}  -  ttJ  <  brv,   j,k  =  l,...,n;   v  =  1,2,... 

(5.B.13) 

Combining  (5.B.10),  (5-B.ll)  and  (5.B.15)  yields 
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s=l        k=l  i-1  -t-~i 

n  n  n        ,    ,    n 

<      E    tt        E    t.m  .       £   brJ         I   ^^pm-\p 
-  5=i  s  k=l  sk  sk  1=1  -£=1  xl  ll 

=    [b   S    .-.      ^5tsk»sktuV]r  .        (5.B.14) 

Clearly,  the  right  hand  side  of  the  inequality  (5.B.14) 
is  a  tern  of  a  summable  geometric  series,  hence  y(j)  is 
absolutely  summable. 

From  the  Lebesque  Convergence  Theorem  (Royden,  1963, 
p.  200)  if  g(x)  is  integrable,  | f n ( x ) |  <  g(x)  and  fR(x)  -  f(x) 
then  /f(x)  =  11m  /fnU)-   Identifying  |y(j)|  =  g(J), 
fn(J)  -  T(n)(^)J'e^1/n  and  z  =  (^)Vj/n,  v;e  have 

IYQ)  =  lim  E  Y(j)(?lzi)Jeij/n  =  C(l)      (5.B.15) 


j  =  l       n+°°  j  =  l 


n 


It  remains  to  shov;  that  (Ie~   -T)    exists. 

If  the  determinant  |Ix-T|  =  0  then  the  inverse  (Ix-T) 
is  not  defined.   However,  j Ix-T 1  =  0  is  the  characteristic 
equation  for  the  Markov  chain  described  by  T  and  there  are 
at  most  n  distinct  roots.   Since  T  is  ergodic,  x1  =  1  is  a 
root,  and  for  all  other  roots  the  inequality  |x|  <  1  holds 
(Feller,  1968,  Ch.  16).   Since  |e"  W |  =  1,  and  for 
w  *   2kTi,  k  =  0,±1,±2,...,  e"iw  ¥   1,  e~lli)  is  not  a  character- 
istic value  of  T  for  0  <  u>  <  2tt,  hence  (Ie    -T)    exists. 
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Now,  let  z  =  e     for  some  0  <  tt  <  2ir.   Then  from 


(5-B.ll), 


CO 

C(e-iaJ)  =   E  /MfT^^-T^Mle-110 


=  TrTM1{(Ie:LW-T)-1-T00(e-lw-l)-1}M1l  ,  (5.B.16) 


and 


f+((o)    =    {I+(l/a2)[C(e"iu)  +  C(elt0)]}/TT 


=    {l+^M-j^Cde^-T)    1+(Ie    iw-T)    1+Tc°]M1l/a2}/TT 


(5-B.17) 


Equation    (5.B.15)    extends    f,(u)    to    to   =    0    and   w   =    2tt. 
Using    (5.B.M, 

f+(w)    =    7LT{M2  +  M1(Ieia)-T)"1+(Ie~iaJ-T)"1]M1}l/(a2TT)3 

which  is  Equation  (5.B.5),  thus  completing  the  proof  of 
Theorem  V.B.2. 

The  form  of  the  spectrum  is  an  important  part  of  this 
research.   In  particular,  the  form  of  the  interval  spectrum 
of  a  semi-I'arkov  generated  point  process  is  that  of  a  mixed 
moving  average-autoregressive  process.   The  following 
theorem  states  this  fact  explicitly: 
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Theorem  V.B.3:   The  spectral  density  (5.B.5)  can  be 
written  as 

J 

E  a.cos  j 

f+(w)  =  Q  ^ ,  (5.B.18) 

E  3,  cos  k 
k=0  k 


where  Q,  J,  K,  ex.,  j  =  1,...,J  and  3,,  k  =  1,...,K  depend  on 

J  K 

T,  M  ,  H?,  and  on  the  size  of  the  state  space,  n. 
Proof:   Examine  the  form 


tttM  (Ix-T)   Ml  =  Z(x)  •  (5.B.19) 


Assuming  x  is  not  a  characteristic  value  of  T,  the  inverse 
exists,  and  Z(x)  is  a  scaler.   Inverting  (Ix-T)  by  the 
adjoint  method  (see  for  example  Finkbeiner,  1966)  the  adjoint 
elements  will  be  polynomials  in  x  of  degree  n-i  or  less. 
The  determinant  |Ix-T|  is  a  polynomial  of  degree  n,  so 
(5.B.19)  can  be  written 

Z(x)  -  {TTTM]LAdj(Ix-T)M1l}/|Ix-T|  ,  (5.B.20) 

which  is  the  ratio  of  (n-l)th  and  n-th  degree  polynomials 
in  x,  so 


13't 


n_1     j 

I      a.xJ 
Z(x)  -  ^ .  (5.B.21) 

Z   b,  xk 
k=0   K 


Now, 


n-1   n 
2  Z    Z  a.b  cos(j-k) 


Iok  ,„,  -Igk        j=0  k=0  J'  k 


Z(e^")+Z(e  -"")  = 


n-1   n  n   p 

2  1     I   b  b„cos(k-£)+  Z  bT 

k=0  £=k+l  K  j=0  J 


(5.B.22) 

Substituting  (5.B.22)  in  (5.B.5)  with  suitable  identifica- 
tion of  terms  results  in  (5.B.22)  which  is  the  spectrum 
of  a  finite  mixed  autoregressive-moving  average  process. 
This  completes  the  proof  of  Theorem  V.B.3. 

V.C.   EXTENSIONS  TO  HIGHER  ORDER  SPECTRA 

Defining  the  trivariance  function  in  a  natural  way,  let 

Trv(X,Y,Z)  =  E[{X-E(X)HY-E(Y)HZ-E(Z)}]. 

Then   for   the    stationary    sequence    of   synchronous    intervals 
in  a   semi-Markov   generated  point   process,    we   have 

Theorem  V.C.I:       Trv(Xr ,Xp+j ,Xr+j+k)    -    x(j,j  +  k) 

=   irTMnCT«J-1M1Tk-1-T<oMn(TJ-1+Tk-1+TJ+k-1-2T0°)]M1lJ 

—         lxl  -I- 

J,k        1  (5.C.1) 
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Proof:   Since  the  process  is  stationary, 
E[Xr!  =  EtXr+J]  -  y  and 


Trv(Xr,Xr+..,Xr+.+k)  =  xCJ.J+k) 


E[(X  -u)(X,-y)(X.+,  -y)] 


E[X0X.Xj+k]-yE[XoX.+XoXk+XoX.+k]+2y3.      (5.c.2) 


Arguing  as  in  the  proof  of  Theorem  V.B.I, 

E[X0XjXJ+k]    -   1TH1TJ'~1M1Tk-1M1l.  (5-C.3) 

Substituting  (5.C.3)  and  (5.B.10)  in  (5.C.2)  yields  (5. CI). 
This  completes  the  proof  of  Theorem  V.C.I. 
Similarly, 

T(j,j)  =  TLTM1[(Td"1-Tto)M2-2T0°M1(Tj"1-TtO)]M1l  >     (5.C.U) 


x(0,j)    -   2Tffl2TJ    1M1-M1T00[2M1TJ    1M1+M2-2M1T°°M1]}1J    (5.C.5) 


and 


x(0,0)    -   ttt[M  -T0°(3M2-2M1T00M1)]1   .  (5.C.6) 
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Rosenblatt  and  Van  Mess  (1966)  list  the  following  symmetries 
in  the  trivariance  function  of  a  stationary  process: 

x(j3k)  =  t(kj)  =  T(-j,k-j)5  (5.C7) 

which  indicates  that  T(j,k)  is  completely  specified  by  its 
values  over  any  one  of  the  following  six  sectors  along  with 
the  boundries: 

Section  1 :  0  <  j  <  k 

Section  II:  0  <  k  <  j 

Sector  III:  j  <  0  <  k 

Sector  IV:  j  <  k  <  0 

Sector  V:  k  <  j  <  0 

Sector  VI:  k  <  0  <  j  (5.C.8) 

Define  the  bispectrum  of  intervals  by 


00  00 


2 


b(u    ,w    )    «    [    I  Z      t(j  ,k)exp{-iw   j-ncop kll/RiT    t(0,0)], 

1    d  j=_co  k=_co  1 

-ir  <  «.,u2  <  n.  (5.C.9) 


In  view  of  (5.C.8),  (5.C.9)  can  be  expressed  in  terms  of 
sector  I  values  only: 
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-i((u   +td    )j+u   k)      -i(  (go  ,+aO  j+io-,k) 
b(w,,w5)    =    {    I         I      T(j,j+k)[e  L      d  d      +e  X      d  X 

1      ^  j=l   k-1 

i((oj1+cj2)k+to    1)       i(  (to    +a)2)k+oj   j  )       -i(kto    -jaj„)       i(jio ,-ktOp) 
+   e  +e  +e  +e  ] 

-iuj      -iw   j       i(co   +co    )j 
+      I  -T(0,J)[e        d   +e        x   +e        x      d      ]    +   t(0,0) 
j  =  l 

+ico  j      iw  j      -i(o)1+a)„)j  „ 

+      I    T(j,j)[e        L   +e      d   +e  x      d      ]}/(^ttS  (  0  ,  0)       (5. CIO) 

To   evaluate    (5.  CIO)    in   view   of    (5.  CI),    (5.C.5),    (5.C.6) 

and    (5.C.7),    the    following   formulae   will   be   useful.      For   a, 

-a        -b 
b   such   that    e      ,    e        <    1   and.  not    characteristic   values    of   T, 


CD  OO 

I        I    TJ"1M,Tk_1e~aj'"bk   =    (Iea-T)_1M    (Ieb-T)-1,  (5.C11) 

j=l   k=l  x  L 

CO  CO 

I        Z      e~aj-bk   =    (ea-l)~1(eb-l)~1J  (5.C.12) 

j=l  k=l 

OO  CO 

I        I   jJ-ie-aj-bk  =    (eb_1)-l(  Iea_T)-l  ^  (5.C13) 

3=1   k=l 

CO  CO 

I        I   Tj+k-l.-aj-bk   =   T(Iea_T)-l(Ieb_T)-l^  (5.C.11]) 

J  =  l   k=l 

CO  CO 

Let  x  (a,b)  =  I        I    t  ( j  ,k+j  )e~aj'~bk  .   Then  from 
j  =  l  k=l 
(5. CI),  (5.CO  through  (5.C.7)  and  (5.C.11)  through 

(5.0.14), 


138 


T*(a,b)    =   TTTM1{(Iea-T)~1(Ie   b-T  )~1-1^\ .[  (eb-l)    1(Iea-T)"1 


+    (ea-l)~1(Ieb-T)~1+T(Ieb-T)"1(Iea-T)"1 


Let 


-    2Ta=(ea-l)"1(eb-I)"1]}M1I 


(5.C15: 


x    ( a )    =      Z    x  ( j  ,  j  )  e 


-aj 


=    7LTM1{[(Iea-T)    iTC°(ea-l)~1]M 


and 


-    2TM1[(ea-l)"1TM(ea-l)"1]H1}l  (3.C16) 


t    (a)    =      Z    T(05j)e 


*  ^~aJ 


o 


j  =  l 


=    TLTM2(Iea-T)    1M1l-21TM1TC°(Iea-T)    XM   ]_ 


a    ,  •  -1 


-jjT{M1TroM2]_(ea-l)    "^M    T°°M    T°°M    T_(ea-1)    1]    (5.C.17) 


Finally,    substituting    (5.C.15),    (5.C.16)    and    (5.C.17) 
in    (5.C10)    gives    the   result 
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r  it  Tr 

b((jj,jWp)  =  (t  (  ((jj1+cj2)I  ,u)pi)  +  T  (  (co,+u)p)i,w,i)+*r  (-w,i  ,-(w,  +Wp)  i 


*  *  * 

+  t  (-oj  ij-(co-,+ajp)i)+T  (-Wpi  ,w,  i)+x  (a),i,-Wpi) 


+  t  ((w,+«2)i)+T  (-w1i)+T  (-oj2i)  +  T(030) 


+  T*(-(uJ1+a)2)i)  +  T*(Wli)+T*(uj2i)}/(^7T2T(030))        (5.C.18) 


The  existence  of  b(<o-,>a)p)  is  shown  in  a  manner  similar 
to  that  in  the  proof  of  Theorem  V.B.2. 

In  general,  n-th  order  spectra  are  defined  as  Fourier 
transforms  of  functions  of  n-th  order  joint  moments,  fre- 
quently cumulants  (see  Erillanger,  1965,  1972;  Tukey,  1959). 
The  key  step  in  determining  the  n-th  order  spectrum  of  any 
moment  function  is  to  observe  that,  that  for  this  process, 


E[X  X X  . .  ] 

o  j     x+k 


=  t/m^T"3  1M1...M1Tk  1)M11,   j,...,k  -  1,2,3,.. 

(5.C19) 


and 


E[X.  .  .Xrx, . .  .X  ,,  ] 

v+j     s+k 


£TM1(...TJ  1Mr...Tk  1)M11  .  (5.C20) 


l'lO 


Thus  the  joint  interval  structure  is  completely  characterized 
in  terns  of  M  ,...,M  ,ir,  and  T,  with  spectral  representation 
depending  on  the  choice  of  moment  function. 

It  may  be  observed  at  this  point  that  the  joint  inter- 
val distributions  are  directly  accessible.   Referring  to 

Lemma  V.B.I,  we  see  that  the  arbitrary  interval  density  is 

2 

a  linear  combination  of  the  n   transition  densities.   Com- 
bining this  idea  with  the  construction  of  (5.C.19)  gives 
the  result 


fo,j',k(uu'U2'U3)  =  ttTg^1)tJ  1G(u2)Tk_1G(u3)l  ,     (5.C.21) 


where  f   .  ,  (u.v.w)  represents  the  joint  density  of  the 
o ,  j  ,  k   '  ' 

intervals  0,j  and  j+k.   This  result  can  be  generalized  to 
any  combination  of  intervals. 
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VI .   THE  ERLANG  AND  HYPEREXPONENTIAL  SUPERPOSITION 

PROCESSES  AS  gEMI^MARKQV  GENERATED  POINT  PROCESSES 

In  Chapters  III  and  IV,  the  nature  of  the  spectral 
representation  of  Eriang  and  hyperexponential  superposition 
processes  was  examined.   The  algebraic  manipulations  proved 
difficult  and  unv/eildy  for  all  but  the  simplest  processes. 
In  this  chapter,  the  "method  of  stages"  is  exploited  to 
derive  semi-Markov  generated  point  processes  which  are 
equivalent  with  the  Eriang  and  -hyperexponential  super- 
position processes. 

In  addition  to  the  computational  savings  resulting  from 
the  semi -Markov  representation,  higher  order  spectral 
estimates  become  feasible.   The  development  of  higher  order 
spectra  is  desireable  because  the  various  processes  are  not 
uniquely  defined  by  second  order  spectra  which  are  indis- 
tinguishable from  those  of  a  stationary  mixed  autoregressive/ 
moving  average  process.   Higher  order  joint  moments  are  not, 
in  general,  available  for  the  general  superposition  of  iid 
renewal  processes,  but  can  be  determined  for  the  Eriang  and 
hyperexponential  superpositions  by  means  of  the  semi-Markov 
modeling  described  below.   In  Section  A  the  E(k,p)  process 
is  shown  to  have  an  equivalent  semi-Markov  generated  point 
process  representation.   Independence  beyond  the  first  lag 
is  shown  for  the  E(2,2)  process,  and  computational  considera- 
tions are  discussed  with  regard  to  determining  the  matrices 
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T  and  E  of  Chapter  V  for  the  general  E(k,p)  process. 
State  space  reduction  and  compression  receive  special 
attention. 

Section  B  is  devoted  to  the  modeling  of  the  H(k,p;q,A_) 
process  as  a  semi-Markov  generated  point  process. 


VI. A.   THE  E(k,p)  PROCESS  AS  A  SEMI-MARKOV 
GENERATED  POINT  PROCESS 

Let  Y  =  >'  +X~+.  .  .+X,  .  where  Pr[X,>x]  =  e"Xx  .   Then  Y 

has  the  probability  density  function 


fY(y)   -   \kyk~VXy/(k-l)< 


=   Yy(k,X)       . 


This  well  known  fact  that  the  sum  of  k  exponentially 
distributed  random  variables  has  the  Erlang  distribution 
is  the  key  property  which  allows  the  modeling  of  an  Erlang 
superposition  process  as  a  semi-Markov  process. 

In  the  "method  of  stages"  the  random  variable  Y  is 
thought  of  as  proceeding  through  k  stages,  the  delay  times 
independent  and  with  identical  exponential  distributions 
over  all  stages.   A  realization  of  Y  occurs  upon  termination 
of  the  k-th  stage.   Y  is  said  to  be  in  stage  i  at  t  if 


and 


x1+x2+. . .+X±<t 


xx+x2+. . .+x1+1>t 


l'»3 


Assume  that  p  independent  renewal  processes  with 
identical  Erlang  inter-event  distributions  are  observed 
concurrently.   A  state  space  can  be  defined  in  the 
following  way: 

Designate  each  process  as  process  i,  1=1, ...,p,  and 
denote  the  current  stage  of  process  i  by  s.=l,...,k.   Then 
define  the  state  space 

S  =  {(s13.  ..,sp)} 

as  the  set  of  all  combinations  of  stages. 

A  transition  occurs  whenever  a  component  process 
advances  one    stage  and  each  component  process  cycles 
repetitively  through  stages  1, . . . ,k,l, . . . ,k,l, . . .   A  renewal 
event  occurs  in  process  i  whenever  it  makes  the  transition 
from  s.=k  to  s.=l. 

Note  that  in  this  formulation  direct  transitions  are 

possible  from  s°=(s° , . . .  ,s° )  to  s J  =  (s]  ,  .  .  .  ,  s  \  )  only  if  for 
—    x      p     —    1      p 

some  1=1,..., p   (s°+e.)   ,  , =s1.  where  e.  is  a  vector  of 

—  —l  mod  K  —         — i 

zeroes  except  for  a  one  in  the  i-th  position. 

In  this  particular  formulation,  transition  times  are 
the  same  for  all  transitions.   Because  of  the  lack  of  memory 
property  of  the  exponential  distribution,  if  the  system  is 

observed  at  any  time,  the  time  to  the  next  stage  in  any 

-At 
process  has  the  residual  life  distribution  R(t)  =  e 

The  next  transition  is  the  minimum  over  the  p  processes  of 

the  time  to  the  next  stage.   Thus  the  time  to  the  next 


ll|i| 


transition  in  the  superposition  process  has  the  residual 
life  distribution  FTp)(t)  =  e~pAt.   Clearly,  the  process 
which  actually  advances  is  process  i  with  probability  1/p , 
since  we  assume  that  the  component  processes  are  identically 
distributed  and  independent. 

Example  VI. A. 1.  The    E(Z}2)    process.       Let  k=3  be  the 
shape  parameter  of  the  Erlang  renewal  distribution,  and  let 
p=2  be  the  number  of  component  processes.   The  state  space 
is 


S={ (1,1), (1,2), (2,1), (2, 2), (3, 2), (2, 3), 

(3, 3), (3,1), (1,3)>  .  (6.A.1) 


Figure  VI. A. 1  shows  a  network  of  possible  paths  of  the 
Markov  chain  through  the  state  space.   When  the  process 
enters  a  state  enclosed  in  a  box,  a  component  process  event 
occurs,  and  the  process  continues  as  from  the  circled  state 
of  the  same  number. 

Recalling  that  the  residence  time  in  any  state  has 
residual  life  distribution  p/p) (t )  = e~pAt ,  observe  that  if 
the  process  is  in  state  (1,1),  there  are  two  paths  by  which 
the  process  can  leave  and  reenter  that  state  without  any 
intervening  events.   Since  each  branch  from  the  state  is 
chosen  with  probability  1/2,  the  probability  that  a  particular 
path  is  chosen  Is  2~  ,  where  n  is  the  length  of  the  path. 


Thus  the  lower  branch  from  (ll)  to 


© 


11 


will  be  realized  with 


_-5 

probability  2  J .      Given  that  a  particular  path  Is  chosen,  the 


1'I5 


21 

31 

Figure  VI. A. 1   Transition  network  for  the  E(3,2)  process 
Times  of  transitions  into  states  enclosed  in  boxes  are 
recorded  as  events  in  the  point  process.   The  transition 
process  continues  from  the  circled  state  with  the  same 
index  pair. 
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time  until  the  next  event  is  governed  by  the  density 


Yt(n,pA)  =  (pA)ntn-VpU/(n-l)!  (6. A. 2) 


In  this  example,  if  the  process  is  in  state  (1,1),  the 
probability  that  the  next  event  is  associated  with  a 
transition  back  into  state  (1,1)  is 

Pr[(l,l):(l,l)]  =  2(1/8)  =  1/4   , 

while  the  time  until  the  next  event,  given  that  it  represents 
a  return  to  (1,1)  is  governed  by  Yt(3»2X)  with  expectation 
3/2A.   The  colon  is  used  to  denote  a  direct  transition 
between  the  states  indicated. 

We  will  return  to  this  example  on  several  occasions  to 
clarifty  the  development. 

VI . A . 1 .   Reduced  State  Space,  Sr 

Since  the  superposition  process  events  are  associated 
only  with  certain  transitions,  it  is  desireable  to  focus 
attention  on  a  subset  of  the  state  space.   A  new  process  may 
be  defined  which  has  as  a  state  space  those  elements  of  S 
which  correspond  to  at  least  one  component  process  being  in 
stage  one . 

Example  VI. A. 1  (continued).   In  the  E(3,2)  process, 
the  reduced  state  space,  denoted  S  ,  takes  the  form 


Sr  ■  {(1,1), (1,2), (2,1), (3,1), (1,3)1 


1'I7 


In  S,  (6. A. 1.1),  the  path  [ (1,1) : (1,2) : (2,2) : (3,2) : (1,2)] 

in  Figure  VI. A. 1  would  correspond  to  the  transition 
[(1,1) : (1,2) ]  in  the  reduced  space,  S  .   Transition  time 
would  be  governed  by  y,(^,2X).      Transition  probability  is 


Pr[(l,l):(l,2)]  =  N/24  , 


where  N=3  is  the  number  of  paths  in  5  starting  in  state 
(1,1)  and  terminating  with  an  event  in  state  (1,2),  having 
no  intervening  events. 

Continuing  with  the  general  presentation,  there  are 
two  advantages  to  the  use  of  the  reduced  state  space,  S    . 
First,  the  cardinality  of  S  is  | S | =k*  .   Although  \S    |  grows 
rapidly  with  k  and  p,  it  is  much  smaller.   An  expression  for 
\S    |  is  not  given  because  it  is  rather  complicated,  and  the 
next  step  in  the  state  space  reduction  process  renders  it 
unnecessary.   The  main  value  of  state  space  reduction  is 
that  if  the  transition  pattern  in  the  reduced  state  space 
has  retained  the  Markov  property,  then  by  considering  the 
transition  times  in  5   as  events  in  a  point  process,  we  have 
a  semi-Karkov  generated  point  process  as  defined  in  Chapter  V, 

Clearly,  the  /.arkov  property  is  retained  through  the 
reduction  process.   That  is,  the  transition  probabilities 
associated  with  any  state  s  in  S      are  independent  of  the 
evolution  of  the  state  space  prior  to  entering  s. 
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•  VI. A. 2.   Transition  Probabilities  in  S^ 

Examine  the  direct  transition  in  5   from 

u°  =  (s,  , . .  .  ,s  )  to  u1=(s'  ...,s'  . ,1) .   This  transition 
—    i  p     —    i      p-i 

corresponds  to  a  path  in  S 


v°  =  (B1,...,sp):...:(sj_,...,s^_1,k):(s£,...,s£-1,l)  =  v 

(6. A. 2.1) 

with  all  intervening  states  v1 ,  i=l,...,r-l,  satisfying  the 
inequality 


v1  >  v1"1    .  (6. A. 2. 2 


where  it  is  understood  that  the  inequality  holds  for  each 
element  of  the  vectors.   The  inequality  condition  (6. A. 2. 2) 
precludes  an  intervening  event  in  the  path  (6. A. 2.1). 

Recall  that  in  S,    the  choice  of  the  state  following 

any  initial  state  is  an  event  of  probability  1/p .   The 

r— 1 
number  of  transitions  from  v   to  v    is 

P-l 
r-1  «  I      (s'-s.)  +  (k-s  )  (6. A. 2. 3) 

J=l   J   J        p 

(The  process  p  was  chosen  arbitrarily  as  the  source  of  the 
event.   Any  other  process  would  have  the  same  property,  but 
would  be  more  cumbersome  notationally . )   The  number  of  paths 
in  S  satisfying  (6. A. 2.1)  and  (6. A. 2. 2)  is  given  by  the 
multinomial  coefficient 


1**9 


N  =  (r"1)! (6.  A.  2. 10 

P-1 
{  n   (s!-s  )!}(k-sn)! 
J=1    J   J        P 


Combining  (6.A.2.3)  and  (6.  A.  2.^0,  and  noting  that 


r— 1 

Pr[v    :v]  =  1/p  gives 


o  .,  i  1  _  M  ,„v 


Pr[u° :ux]  =  N/p1   .  (6. A. 2. 5) 

Further,  the  transition  time  associated  with  this  event  is 
governed  by 


f  o.ni(t)  =  Yt(r,pA)  (6. A. 2. 6) 


since  (u0:^1)  represents  r  realizations  of  iid  exponential 
(pX)  random  variables. 

Example  VI. A. 1  (continued).   In  the  reduced  state 
space,  S  ,  associated  with  the  E(k,p)  process,  the  matrices 
of  transition  probabilities  and  transition  time  densities 
can  be  developed  using  (6. A. 2. 5)  and  (6. A. 2. 6).   These 
matrices  are  shovm  in  Figure  VI. A. 2  and  Figure  VI . A . 3 
respectively. 

VI. A. 3.   The  Collapsed  State  Space,  S 

Study  of  Figures  VI . A . 1 ,  VI . A . 2  and  VI. A. 3  reveals 
a  degree  of  symmetry  v;hich  suggests  a  further  reduction  In 
the  size  of  the  state  space.   In  particular,  it  is  possible 
to  treat  all  permutations  of  a  set  of  permissible  stage 
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Figure  VI. A. 2   Transition  matrix  for  the  E(3,2)  process; 

Reduced  state  soace  (S  ) 

r 

The  states  are  denoted  (ij).   A  matrix  element  is  the 
probability  the  next  "boxed"  state  (See  Fig.  VI. A. 1) 
entered  is  (ij )  given  the  previous  "boxed"  state  is  (kn) 
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(11) 


(12) 


(21) 


(13) 


(3D 


(11)    /Yt(3,2X)     Yt(4,2X)     Yt(^,2X)     Yt(5,2X)     Yt(5; 


2XV 


(12)     Yt(2,2X)     Yt(3,2X)     Yt(3,2X)     Yt(^,2X)     Yt(^,2X) 


(21) 


(13) 


YtC2,2X) 


Yt(l,2X) 


Yt(3,2X) 


Yt(3,2X) 


Yt(232X) 


Yt(^,2X) 


Yt(3,2X) 


Yt(^,2X) 


Y*(3,2X) 


(31)    \Yt(l,2X)     Yt(252X)        0 


Yt(3,2X)     Yt(3,2X)i 


Figure  VI. A. 3   Transition  time  densities  for  the  E(3,2) 
process;  reduced  state  space  (S  ) 

The  state  representation  is  as  in  Fig.  VI. A. 2.   Given  that 
the  system  has  just  entered  state  (kn)  and  the  next  "boxed" 
state  (Fig.  VI. A. 1)  is  (ij),  the  time  of  transition  will  be 
governed  by  the  Erlang  density  indicated. 
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values  as  a  single  state  denoted  by  a  generic  element. 

Thus  w  =  { (s,  , . . . ,  s  ) }  would  represent  all  states  of  S   which 

are  distinct  permutations  of  the  elements  of  w.   The  collapsed 

state  space  is  S    ,    the  partition  of  S   defined  by  the  sets  W. 

The  states  of  S   will  be  denoted  by  lower  case  script  letters 

indicating  their  roles  as  sets  of  states  from  S  .   States 

r 

of  5   will  still  be  referred  to  in  vector  notation  as 
underlined  lower  case  letters. 

In  Example  VI. A. 1,  5c={  1,1  ,  1,2  ,  1,3  }. 

The    cardinality   of  5      is   given   by 


l*„l    <T~12)  '  (6.A.3.1) 

the  figurate  number  for  k  types  of  elements  taken  in  sets 
of  size  p-1 .   Figure  VI. A. k    compares  \S\   with  |5  |  for  k  and 
p  taking  values  2  through  5. 

To  be  useful  in  view  of  the  results  of  Chapter  V, 
transitions  within  the  collapsed  state  space,  5   must 
exhibit  the  Markov  property.   That  is,  it  is  necessary  to 
show  that  S   with  its  transition  probability  matrix,  T  , 
is  a  lump able  Markov  chain  with  respect  to  the  partition  S^. 

Following  Kemeny  and  Snell  (I960,  Ch.  4),  a  Markov 
chain,  C,  is  said  to  be  lump able  with  respect  to  a  partition 
A={A,  ,...,A  }  if  for  every  starting  vector  u,  the  lumped 
process  is  a  Markov  chain  with  transition  probabilities 
independent  of  tt_.   A  necessary  and  sufficient  condition  that 
C  be  lumpable  with  respect  to  the  partition  A  is  that  for 
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Figure  VI. A. 4   Comparison  of  state  space  size  for  the  E(k,p) 
representations  S  and  5  .   The  dimension  of  the  stage 
transition  Markov  chaincis  |S|  =  kp .   The  dimension  of  the 
reduced,  collapsed  state  space  is 


S. 


-Ct:i!) 


154 


every  pair  of  sets  A  ,  A.,  pr{n:A  }  =   Z    Pr{n:m}  has  the 

1    J        J   .  meA. 
same  value  for  every  state  n  contained  in^A  .   These  common 

values,  {t.  .},  form  the  transition  matrix  for  the  lumped 

chain,  A. 

Formally,  we  state 

Theorem  VI. A. 1:  The  Markov  chain  S  is  lumpable 
with  respect  to  the  partition  5  . 

Proof:   It  is  sufficient  to  show  that 


Pr[u= (s  , . . . , s  ) :w-{s ' , . . . ,s ' } ]  =  constant 


for  uc{(s1, . . .  ,s  ) }  . 

First,  let  u  and  w  be  generic  names  of  elements  of 

S   and  assume  that  a  direct  transition  from  u  to  w  is 
c 

feasible  in  S  .   That  is,  there  exist  elements  u  and  w  in  u 
and  w  and  a  path  in  S,  (u: v  : . . . :v   -.  :w)  satisfying  the 
inequality  (6. A. 2. 2).   Further,  suppose  process  m  is  that 
process  which  records  an  event  in  the  transition  from  u  to 
w.   Then  the  number  of  steps  from  u  to  w  is  given  by 
(6. A. 2. 3)  as 


r  =  I      (s'-s.)  +  (k+l-s_) 
jVm   J   J  m 


I       s!  -   E   s ,+1   ,  (6. A. 3.2) 

j  =  i  J   3-1  J 


since  s'=k  by  construction.   Thus,  the  number  of  transitions 
m 


lrO 


in  S  corresponding  to  a  transition  from  an  element  of  u  to 
an  element  of  W  is  independent  of  the  elements  chosen. 
Hence , 

PrCu^w]  =  N../pr,   i  =  ls...,n,  (6. A. 3. 3) 


where  N.  is  the  number  of  distinct  paths  in  S  satisfying 
(6. A. 2. 2)  beginning  at  u.  and  terminating  at  an  element  of 
w.   Here,  n  represents  the  number  of  distinct  permutations 
of  the  elements  of  u. 

Let  N. .  be  the  number  of  paths  from  u.  e  a  to 
w.  e  io,  where  again  process  m  has  recorded  the  transition 

J 

event .   Then 


N,,  =  (n-1)! ,  J  =  l,...,t;  1  =  l,...,n 


ij 


{  tt  (s'-s.)!}(k-s)! 
jVm  J   J       m  (6.A.3.4) 


and 


t 
N,  =  Z  N,,  ,  (6. A. 3.5) 

1   3=1  1J 


where  t  is  the  number  of  distinct  permutations  of  w. 

*      *       * 
Let  u.  =  (s .,..., s  )  be  any  other  element  of  a. 

Then  there  exists  a  one  to  one  mapping,  h,  of  u . ,  onto  u, 

*  *      *      * 

such  that  h(s.)  =  s, .   Then  a  new  element  w.  =  (s',...,s!) 

J     i  -1     1      p 

is  formed  from  h(s')  =  s'    It  follows  that  M . .  =  N..  and 

« 

N^  =  N   =  II(u,(c).   Hence  the  lumpability  condition  is 

satisfied,  thus  completing  the  proof  of  Theorem  VI. A. 1. 
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The  transition  probability  matrix  for  the  collapsed 
state  space  is 


T  =  {Pr[u:w]|u,weS  } 


{  £  Pr  [u:w]|u,w>eS  }  .  (6.  A.  3. 6) 

wew  c 


The  transition  time  density  matrix  is 


F(t)  -  {Yt(N(u,w),pX)|u,«;eSc}  (6. A. 3. 7) 


Returning  once  more  to  Example  VI. A. 1,  Figures  VI. A. 5  and 
VI. A. 6  show  the  matrices  of  transition  probabilities  and 
transition  densities,  extracted  from  Figures  VI. A. 2  and 
VI. A. 3.   For  example, 

Pr[U,2},{l,2}]  =  Pr[(l,2):   (1,2)]  +  Pr[(l,2):  (2,1)] 

=  3/8 
VI.A.3.a.   Proof  of  Theorem  III. A.  2 

Theorem  III. A. 2  claimed  the  interval  spectral 
density  of  an  E(k,p)  process  Is  expressible  as  the  ratio  of 
finite,  rational  polynomials  in  cos  w.   Theorem  V.B.3  showed 
the  same  result  for  the  interval  spectral  density  of  a 
univariate  semi -Markov  generated  point  process.   In  this 
section  it  has  been  shov;n  that  an  E(k,p)  process  has  an 
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Figure  VI. A. 5   Transition  matrix  for  the  E(332)  process; 
collapsed  state  space  (Sc) . 

The  states  are  denoted  {ij}  to  indicate  their  functions  as 
sets  of  states  in  Sr.   That  is  {ij}  =  {(i.j  ) ,  (ji) } .   As  in 
Fig.  VI. A. 2,  transitions  represent  movement  between 
"boxed"  states  in  Fig.  VI. A. 1. 
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{21} 
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|Yt(3,2A)        Yt(^,2A)        Yt(5,2X) 


Yt(2,2X)        Yt(3,2A)        Yt(4,2A) 


|Ytd52X) 


Yt(2,2X)        Yt(3,2X)| 


Figure  VI. A. 6   Transition  time  densities  for  the  E(3,2) 
process;  collapsed  state  space  (S  ). 

State  space  representation  as  in  Fig.  VI. A. 5. 
Interpretations  of  entries  as  in  Fig.  VI. A. 3- 
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equivalent  representation  as  a  semi-Markov  generated  point 

process,  thus  establishing  Theorem  III. A. 2  as  a  special 

case  of  Theorem  V.B.3. 

VI . A . 4 .   The  E(2,2)  Process  as  a  Semi-Markov  Generated 
Point  Process 

Let  N.(t),  i  =  1,2  be  a  point  process  with  indepen- 
dent identically  distributed  intervals  governed  by  the 
Y,(2,A)  density.   Let  N(t)  =  N  (t)  +  Np(t)  denote  an  E(2,2) 
counting  process.   N.(t)  may  be  thought  of  as  a  Poisson 
process  in  which  only  alternate  events  are  recorded.   Con- 
sider the  process  II.  (t)  to  be  in  stage  one  if  its  next 
event  will  not  be  recorded,  and  stage  two  otherwise.   Events 
in  the  superposed  process,  II  (t),  will  occur  whenever  either 
contributing  process  makes  a  transition  from  stage  two  to 
stage  one. 

Define  the  states  of  the  semi-Markov  process  by 

(i,j)  =  {II  (t)  is  in  stage  i;  N~(t)  is  in  stage  j }  , 

i,j  =  1,2, 

so  that  the  entire  state  space  is 

S  =  {(1,1), (1,2), (2,1), (2,2)}. 

Assume  that  at  some  time  the  process  is  in  state 
(i,J).   Let  V-  and  V0  be  the  times  to  the  next  transition 
in  processes  1  and  2  respectively.   Then,  by  hypothesis, 
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V  and  V   are  iid  obeying  the  exponential  probability  law 
with  rate  X.      Component  process  1  will  advance  before  com- 
ponent 2  if  V   <  V2,  an  event  of  probability  1/2.   The 
time  until  the  next  transition  will  be  V  -  min{V  ,V„} 
which  is  distributed  exponentially  at  rate  2A. 

Transitions  within  the  chain  S  follow  the  pattern 
illustrated  in  Fig.  VI . A . 7 •   From  any  state,  one  of  two 
paths  will  be  chosen  with  equal  probability.   Transitions 
to  the  left  result  in  events  of  N(t).   The  possible  tra- 
jectories from  each  state  terminating  in  a  main  process 
event  are  enumerated  in  Fig.  VI. A. 8. 

The  reduced  state  space  of  the  E(2,2)  process  is 


Sr   =  {(1,1),  (1,2),(2,1)} 


The  transition  matrix  for  the  reduced  state  space  may  be 
derived  from  Fig.  VI. A. 8.   For  example, 

Pr[(l,l):  (1,1)]  =  Pr[trajectory  1]  +  Pr[trajectory  2] 


1/2. 


Similarly,  the  matrix  of  transition  time  densities  may  be 
taken  from  the  table  of  Fig.  VI. A. 8.  Figure  VI . A . 9  lists 
the  transition  probability  and  interval  density  matrices. 
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Figure  VI. A 
Transitions 


7   Transition  network  for  the  E(2,2)  process 
to  the  left  result  in  events  recorded  in  the 


point  process.   Transitions  to  the  right  do  not  have 
corresponding  events. 
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No. 


Trajectory 


Probability 


Distribution 


1 
2 

3 
1| 

5 
6 

7 

- 

9 

10 

11 

12 

13 

11 


(11):(12):(11) 
(11): (21): (11) 

(11):(12):(22) :(12) 
(11):(12):(22):(21) 
(11):(21):(22):(12) 
(11): (21) : (22) :(21) 
(12):(11) 
(21):(11) 
(12):(22):(12) 
(12): (22): (21) 
(21):(22):(12) 
(21)  :(22)  :  (21) 
(22): (12) 
(22): (21) 


1 
T\ 

1 
T\ 

1 
F 

l 
l 
l 
l 

2 

1 
2 

1 

IT 
l 

l 

ir 
i 

? 

1 

2 

1 
2 


Y. 


Y 


Y. 


Y. 


Y. 


Y. 


Y. 


Y- 


Y< 


Y< 


Y- 


Y< 


.(2,2X) 

,(2,2X) 
(3,2X) 

,(332X) 
(3,2A) 
(3,2X) 
(1,2X) 
(1,2X) 
(2,2X) 
(2,2X) 
(2,2X) 
(2,2X) 
(1,2X) 
(1,2X) 


Figure  VI. A.  8   Stage  transition  trajectories  In  the  E(2,2) 
process.   This  is  an  enumeration  of  all  trajectories  from 
any  state  in  the  stage  transition  system,  S,  terminating 
with  an  event  in  the  point  process  (a  transition  to  the  left 
in  Fig.  VI. A. 7).   The  probability  and  distribution  columns 
are  conditioned  on  knowledge  of  the  initial  state. 
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(11) 

(12) 
(21) 


(11) 


1 

1 

2 

1 
2 


(12) 


1 

1 
IT 

l 


(21) 


1 

l 
IT 


Transition  Matrix 


(11) 


(11) 


(12) 


(21) 


(11) 
(12) 
(21) 


Yt( 2  ,2X) 


Yt(l  ,2X) 


Yt(l  ,2X) 


Yt(3  >2A) 


Yt(2  ,2X) 


Yt(2  ,2X) 


Yt( 3  ,2X) 


Yt(2  ,2X) 


Yt(2  ,2X) 


Transition  Tine  Densities 


Figure  VI. A. 9   Reduced  state  space  (S  )  matrices  for  the 
E(2,2)  process. 

Interpretations  of  these  matrices  are  as  in  Figures  VI . A . 2 
and  VI. A. 3. 
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Finally,  lumping  states  (2,1)  and  (1,2)  forms  the 
collapsed  state  space 


Sc  =  {{1,1}, {1,2}} 


(6. A. 4.1) 


with  transition  matrix 


T  = 


1/2     1/2 


1/2     1/2 


(6. A. 4. 2) 


and  interval  density  matrix 


F(t)  - 


Yt(2,2X)     Yt(3,2A) 


lYt(l,2X)     Yt(2,2X) 


(6. A. 4. 3) 


Clearly,  the  stationary  vector  of  T  is 


ir1  =  (1/2,  1/2)   . 


(  6  .  A  .  k  .11 ) 


From  Lemma  V.B.I,  the  density  of  an  arbitrary 
interval  is 


f0(t)  =  TLTF(t)l 


{Yt(l,2)+2Yt(2,2)+Yt(3,2)}/i4.        (6.  A.  4. 5) 
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In  Chapter  VII,  this  result  is  shown  to  be  the  same  as  that 
derived  from  the  expression  for  the  density  of  an  arbitrary 
superposition  interval. 

Lewis,  et  al  (1973)  showed  that  for  the  E(2,2) 
process,  the  serial  interval  covariance  vanished  for  lags 
greater  than  one.   The  semi-Karkov  representation  admits 
the  following 


Theorem  VI. A. 2:   Let  X  be  the  n-th  interval  in  an 

n 

E(2,2)  process,  n  =  0,±1,±2,....   Then  X   is  independent 
of  all  realizations  X.,  j  <n-l.   That  is  to  say 

v 


Pr{X  <t|X   „  =  t„,  X   _  =  t-,...}  =  Pr{X  <t} 
n—  '  n-2     2'   n-3     3  n— 


Proof:   The  interval  X   n  was  terminated  by  the  transition 

n-2  J 

of  one  of  the  component  processes  from  stage  2  to  stage  1 
putting  the  system  in  state  (1,1),  (1,2)  or  (2,1).   Simi- 
larly, the  interval  X   will  begin  with  the  system  in  state 
(1,1),  (1,2)  or  (2,1),  i.e.,  states  {1,1}  or  {1,2}  of  S    . 
Assuming  X  __  terminated  by  a  transition  to  (1,1),  (6. A. 4. 2) 
shows  that  states  {L,I}  or  {1,2}  are  equally  likely  for  the 

commencement  of  interval  X  .   This  is  also  the  case  for 

n 

X   -  terminating  by  entry  into  states  (1,2)  or  (2,1).   Thus 

information  regarding  the  state  of  the  system  derived  from 

the  interval  X   „  provides  no  information  regarding  the 
n-2 

state  of  the  system  at  the  outset  of  X  ,  hence  X   and  X   ~ 

n         n      n-2 
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are  Independent.   Similarly,  all  knowledge  of  the  system 

derived  from  knowledge  of  the  events  X   „,  X   ,,,...,  sheds 

n-2'   n-3 

no  light  on  the  distribution  of  X  . 

n 

This  completes  the  proof  of  Theorem  VI. A. 2. 

To  show  that  a  first  lag  dependence  exists,  it  is 

sufficient  to  establish  that  cov(X  ,X, )  /  0.   To  use  Theorem 

o   1 

V.B.I  which  formulates  the  serial  covariance  of  a  semi- 
Markov  generated  point  process,  it  is  necessary  to  determine 
the  matrix  of  weighted  first  moments,  M  .   Let  U  be  a  random 
variable  with  density  y    (k,X).      Then  E[U]  =  k/A  and 
E[U2]  =  k(k+l)/X2. 


Thus,  using  (6. A. 4.2)  and  (6. A. 4. 3) 


1 1/2 


Ml  = 


3/4 


\i/4    i/\ 


Conventionally,  T°  =  I,  and  in  this  proces: 


T   =  T, 


so 


cov(X  ,X,  )  =  tt  '  f-1  (I-T  )Mn1 
o   1    —   1       ]— 


=  -1/16  X' 
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The  first  serial  correlation  of  this  process  is 


given  by 

P1  =  cov(Xo,X1)/Var(Xo)   . 

Lemma  V.B.2  gives  the  variance  of  the  process 
The  matrix  of  second  moments  is  (from  (6. A. 4.2)  and 
(6. A. 4. 3)) 


M  = 

2 


h/k  x2        3/2  x2\ 


1/H  x2    3/4  X2} 


so 


and 


Var(X  )  =  ttt(M0-M-1T°V  )1 

o    —   2   1    1  — 


=  5/8  X2, 


P;L  =  -1/10  , 


which  Is  the  result  of  Lav/rence  (1973)  as  well  as  Lewis,  et 
al  (1973).   Note  that  while  Lawrence  gave  the  result  that 
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p   =  -1/10  for  this  process,  we  have  established  the  stronger 
result  of  Theorem  VI. A. 1. 

Theorem  V.B.2  gives  the  spectral  representation  of 
the  process.   Computing  first 


dx-T) 


-1 


/x-1/2 
1/2 


1/2' 
x-1/2 


x(x-l) 


then,  taking  i  =  /-T. 


f|   (w)  =  {26+(15e   +l)e    /(e   -l)+(15e    +l)e   /(e    -1) 


=  (5-cos  oj)/5 

which  is  the  form  presented  by  Lev/is,  et  al  (1973).   There 

it  was  derived  by  the  method  outlined  in  Chapter  III, 

Section  A  (above ) . 

VI. A. 5.   Determination  of  T,  and  M   for  the  Collapsed 
E(k,p)  Semi-Markov  Process 

The  ground  work  for  determining  the  transition 

matrix,  T,  of  the  collapsed  state  space,  S  ,  was  established 

in  Subsections  VI. A. 2  and  VI. A. 3.   Equations  (6. A. 2. 3), 

(6.A.2.JJ)  and  (6. A. 2.5)  gave  the  one  stage  transition  in 

the  reduced  state  space,  S    ,    to  be  a  modified  multinomial 

random  variable  for  states  satisfying  the  relation  (6. A. 2. 2), 
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The  lumpability  condition  of  Subsection  VI. A. 3 
states  that  the  sum  of thedirect  transition  probabilities  in 
S   from  an  element  of  a  state  set  { ( j .  , .  .  .  ,  j  ) }  e  S   to 
each  of  the  elements  in  { ( j'  , .  .  .  ,j * )  }  gives  the  collapsed 
space  direct  transition  probability.   In  general,  then,  the 
method  for  determining  Pr[{ ( j  ,  .  .  .  , j  ) } : { j £ , . . . , j ' ) } ] 

is  to  enumerate  the  elements  of  { ( j  '  ,  .  .  .  ,  j  '  ) }  =  { v,  , .  .  .  , y_  }, 

x       p         J_       s 

select  a  particular  element  u  e  { (j  -,,...  ,j  ) }  and  evaluate 

J-  y 

(6. A. 2. 5)  for  all  pairs  (u:v.),  summing  the  results. 

The  process  outlined  is  cumbersome,  although  easier 
to  implement  than  many  of  the  computations  associated  with 
superposition  processes.   V/hile  there  may  be  as  many  as  p 
elements  in  a  collapsed  state  set,  this  will  only  occur  when 
the  indices  contained  in  a  typical  element  of  the  set  are 
all  distinct.   Generally,  several  component  processes  will 
be  in  the  same  stage,  resulting  in  a  multiplicity  of  indices 
in  the  collapsed  state  set. 

Example  VI.  A.  2:  TKa.Yi64.ti.0n    Vftobabilitlni,    In   the 
E(5,2)  PA.0C.Z&6.      In  the  collapsed  state  space  of  the  E(5,2) 
process,  what  is  Pr[ {1 ,1 ,2 , 2, 2} : {1 ,1 ,1 ,2 , 3} ]?   Although 
there  are  20  elements  of  (1,1,1,2,3),  only  six  satisfy  the 
condition  (6. A. 2. 2)  with  respect  to  the  generic  element 
(1,1,2,2,2).   The  condition  is  violated  In  all  cases  in 
which  more  than  one  component;  process  must  enter  stage  1. 
For  example 
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Pr[(l,l,2,2,2):(l,2,3,l,D]  =  0. 

Further,  each  of  the  six  attainable  states  will  be  chosen 
with  equal  probability,  since  for  example 

Pr[(l,l,2,2,2):(l,l,l,2,3)]  ■  Pr [ ( 1 , 1 , 2 , 2  ,2 )  :  ( 1 , 1 , 3 , 2  ,1 )  ] 

Thus,  using  (6. A. 2. 3),  (6.A.2.1J)  and  (6. A. 2. 5), 

Pr[{l,l,2,2,2}:{l,l,l,2,3}]  ■  6(2) (5~3)  =  12/125 

Continuing  the  general  development,  we  examine  the 

moments  of  the  process.   Determination  of  the  M   matrices 

s 

is  a  byproduct  of  the  T  computation.   In  Chapter  V,  the 

( s ) 
matrix  E  =  {y..  }  was  defined  as  the  matrix  of  s-th 
s     ij 

moments  of  the  random  variables,  S..,  of  a  semi-Markov 

process.   In  a  semi-Markov  process  corresponding  to  an 

E(k,p)  process,  the  distribution  of  S . .  is  totally  determined 

by  the  rate  >. ,  and  the  number  of  state  transitions,  r,  from 

state  i  to  state  j  given  by  (6. .A.  2. 3),  where  i  and  j  are 

indices  assigned  two  of  the  state  sets  of  S  . 

c 

It  is  convenient  at  this  juncture  to  establish 

Lemma  VI. A. 1:   Let  X  be  a  non-negative  random 
variable  with  probability  density  function  Yt(r,A).   Then 
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E[Xk+1]  =  X  k  1(r+k)!/(r-l)! 


-  X-1(r+k)E[Xk],  k  =  0,1,2,.. .        (6. A. 5.1) 


Proof:   Formally  operating  on  the  definition  of  expectation 
of  an  Erlang  distributed  random  variable 


co  r— 1 

rrvk+ln     ,  /  k-lv  ,r  x       -Ax  , 

E[X    ]  =  J    (x    )  X  (r_1) i  e     dx 

o 


/  ,,  v.    .  -,    °°  ,r+k-l   r+k   -Xx  , 
(r+k)  !  j,-k-l   ,   X      x    e     dx 


(  -   i       qj  (r+k)! 


(r+k)!  ,-k-l 
(r-1)!  X 


X"1  (r+k)E[Xk] 


Taking  E[X°]  -  1,  so  that  E[X]  =  r/X,  completes  the  proof. 

Returning  to  the  computation  of  M  ,  assign  an  index 
j  =  1,...,VJ  to  each  state  set  of  S  .   Denote  by  r .  .  the 
number  of  stages  separating  the  states  of  i  and  j ,  where 
r  .  is  given  by  (6. A. 2. 3).   Then 


Es+1  =  Hr1J+s)!/(ri.-l)!}/Xs+1 


=  {(rl1+s)^^)}/X  (6. A. 5. 2) 
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and 


Ms*l  ■  {t«(rij+s)^j))/X  •  <6'A-5-3 


In  particular 


M  =  {t. .r. >}/A  (6. A. 5. 4) 


and 


M„  =  {t, .r. .(r.,+i)}/X2.  (6. A. 5. 5) 


The  results  of  the  computation  proposed  in  this  section  and 
applied  to  selected  E(k3p)  processes  are  summarized  in 
Appendix  C. 


VLB.   A  SEMI-MARKOV  GENERATED  POINT  PROCESS  MODEL  OF 
THE  H(k,p;q,X)  PROCESS 

Following  the  procedure  of  Section  A,  let  Y  =  X.  with 

probability  q . ,  j  =  l,...,k,  where  X.  is  governed  by  the 

survivor  function  R.(x)  =  exp{-A.x}.   Then  Y  has  the 

J  J  k 

hyperexponential  survivor  distribution  R(y)  =   £  q.exp{-A.x} 

j  =  l  J      c 
Let  II.  (t)  represent  a  counting  process  in  which  the 

times  between  events  are  iid  random  variables  governed  by 

R(y).   Then  N.(t)  is  said  to  be  in  stage  j  if  the  time  to 

the  next  event  in  the  process  has  the  survivor  distribution 

Rj(y). 
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Let  N(t)  =  Nx(t)  +  ...+  N  (t).   The  state  of  the  process 
N(t)  is  the  vector  (w_,...,u  )  vihere  v.  taking  on  values 
l,...,k  corresponds  to  the  stage  of  component  process  j. 
An  event  occurs  in  the  process  N(t)  whenever  an  event  occurs 
in  a  component  process.   The  state  of  N(t)  will  change  only 
in  that  element  corresponding  to  the  component  process 
responsible  for  the  event,  and  then  only  if  the  component 
process  enters  a  new  stage. 

The  time  between  events  in  the  superposed  process  M(t) 
will  be  the  minimum  of  S.(v. ),  i  =  l,...,p,  where  S. (v. ) 
is  the  time  to  the  next  event  in  process  i  given  that  it  is 
currently  in  stage  v..      Because  of  the  lack  of  memory 
property  of  the  exponential  distribution,  there  is  no  need 
for  concern  with  regard  to  forward  recurrence  time  in  this 
formulation. 

The  probability  that  component  process  m  is  responsible 
for  the  next  event  in  N(t)  is 


Pr[Sm(um}  =  niin1{Si(v;1)}] 


P 
=  X(v  )/  I   X(v, )  ,  (6.B.1) 

m     1=1 


which  is  independent  of  all  history  except  the  current 
state  of  the  system.   Here  A(v.)  is  the  parameter  of  the 
exponential  distribution  governing  a  process  j  in  stage  v. 
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Thus,  a  semi-Markov  process  has  been  constructed  which 

represents  the  superposition  of  p  iid  hyperexponential 

renewal  processes.   Transition  from  state  v  =  (  v,  , .  .  .  , v  ) 

to  v1  =  (v* ,. . . ,u' )  is  possible  only  if  v  and  v'  differ  in 

at  most  one  element.   Let  m  be  the  index  corresponding  to 

the  element  of  v1  which  differs  from  v..      Then,  if  v      =   j 
—  I  m 

and  v'  =  j  '  , 

m 

X.q. , 

Pr[v:v«]  =  — i-J ,  j  f  y  (6.B.2) 

E  X  ( v , ) 

i-1   x 

That  is,  the  probability  of  transition  from  v  to  v'  is  the 
probability  that  the  next  event  is  from  process  m,  and  that 
process  m  enters  stage  j'  following  the  event. 

The  probability  that  the  system  returns  to  its  original 
state  is  given  by 

P 

E  X(ui)q(vi) 

Pr[i/:v]  =  ^-i- — (6.B.3) 

E  A(v.  ) 
1=1   x 

Example   VI.B.l:      The.    H(2,3;£,X)    ?n.oc<L6&.      With   k   =    2   and 

P   =    3 ,    the    survivor    function    is 


-At  -At 

R(t)    =    q1e      X      +    q2e 


and  the  state  space  is 
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S  =  {(1,1,1),(1,1,2),(1,2,1),-(2,1,1),(1,2,2),(2,1J2) 

(2, 2,1), (2, 2, 2)} 


Figure  VI.B.l  shows  the  network  of  possible  transitions. 

Note  that  all  arrov/s  are  double  ended,  and  that  each 
transition  represents  an  event  in  the  main  process . 

The  sojourn  times  in  each  state  are  the  minimums  of 
exponential  random  variables,  hence  are  themselves  exponen- 
tial.   The  mean  time  in  state  (i,j,£)  is  (A.  +  X.    +    X    ) 
for  i,j,£  =  1,2,  where  it  is  understood  that  the  sojourn 
time  is  considered  to  be  the  time  between  events  regardless 
of  the  state  entered  following  an  event.   Transition 
probabilities,  shown  in  Fig.  VLB.  2  are  computed  from 
(6.B.3). 

VI.B.l.   The  CollaDsed  State  Space,  5 

J = 2-    C 

Examination  of  Figures  VI.B.l  and  VLB.  2  suggest 
a  collapsed  state  space  might  be  appropriate  to  this 
problem.   Let  a   =    {(u  ,  ...,u  )}  be  an  element  in  the 

_L  K 

collapsed   state    space,    S    .      Here    a  will   represent    all 
vectors   v   z   S    for  which   u.    elements    of    v   have    the   value   j, 
j    =    l,...,k.      In   Example   VI.B.l,    the    following   correspondence 
applies : 


u   =    (3,0}<    >v   =    (1,1,1) 

u    =    {1,2}<    >v    -    (1,2, 2), (2, 1,2), (2, 2,1) 
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Figure  VI.B.l   Transition  network  for  the  stage  transitions 
in  an  H(2,3j£»20  process. 

In  this  system,  all  stage  transitions  are  recorded  as  events 

in  the  point  process.   In  addition,  it  is  possible  to  have 

direct  transitions  from  a  state  to  itself,  resulting  in  a 
point  process  event. 
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a  -  {2,l}«-»v  =  (1, 1,2), (1,2,1), (2, 1,1) 


a  =  {.0,3><->v  =    (2,2,2) 


Formally, 


S      =    { (u  , . . . ,u,  ) |u.e{0, . . . ,p} ,Eu.=p} .        (6.B.1.1) 

C  X  K      J  J 


The  cardinality  of  S      is  the  same  as  the  number  of  distinct 
sets  of  k  objects  taken  in  groups  of  size  p,  i.e.,  the 
figurate  number 


S|=N=  (  ^P-1 
c '        V   p 


This  compares  favorably  with  the  cardinality  of  S,  |S 
For  example,  if  k  =  5,    and  p  =  3  then  |S|  =  125  while 


=    kp 


IV 


=     7^ 


Two   vectors    a,u'    in   S      are    saxd   to   be   adjacent    if 

,  ,         c  — fe 

k  k 

I  lu.-u'.l  <  2  and   E  (u.-u!)  =  0.   Adjacent  states  in  S 
have  corresponding  states  in  S  which  differ  in  at  most  one 
element,  hence  direct  transitions  in  S   are  possible  only 
between  adjacent  states. 

To  establish  that  the  Markov  property  may  be  ascribed 
to  S  ,  recall  from  Section  VI . A . 3  that  it  is  sufficient 
that  S  partitions  S  in  such  a  way  that  for  each  v  in 
S  represented  by  u    In  S  , 
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Pr[u:u.']   =      £        Pr[v:u']   =    constant 
v'ev1 

For  definiteness ,  assume  that  a  transition  from  u  to  a' 
results  from  a  component  process  in  stage  i  transiting  to 
stage  j  .   In  a,    there  are  u.  processes  in  stage  i,  and  the 
probability  that  one  of  these  processes  generates  the  next 
event  is 


n=l 


which  corresponds  to  summing  the  expression  (6.B.1.1)  for 
the  probability  that  a  particular  process  is  responsible  for 
the  next  event  over  all  processes  in  stage  i.   The  probability 
that  the  chosen  process  will  enter  stage  j  is  q.,  leading 
to 

k 

Pr[u:u' ]  =  u. A.q,/  I  u  X  (6.B.1.2) 

ii  j   2  n  n 

irrrespective  of  the  state  of  S  chosen  to  represent  u. 

Continuing  the  Example  VI.B.l,  the  transition 

matrix  of  the  collapsed  H(2,3;2_SA_)  process  is  shown  in 

Fig.  VLB. 3- 

VI. E. 2.   Expectation  Matrices  for  the  H(k,p,q,A) 
S  g  m  i  *~  I ' . '!  ]?  k  o  v  -  r*  o  c  6  s  s 

As  observed  above,  the  sojourn  time  In  a  state 

k 
a   z   S      is  exponential  with  parameter  0   =   Z  u, X.  independent 
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Figure  VI. B. 3      Transition   Matrix    for   the   H(2,3;q,A)    process; 

collapsed   state    space,    S    . 

}       c 

The  states  in  this  process  are  denoted  {ij}  to  indicate 
their  role  as  partitioning  sets  of  the  state  space,  S.   For 
example,  {21}  =  {(112)  ,  (121)  ,  (211 ) }  ;  {12}  -  {  ( 122  )  ,  (  212  )  ,  (  221 )  } 
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of  the  subsequent  state.   By  Lemma  VI. A. 1,  if  X  has  proba- 
bility density  function  f(t)  =  Ae~At  =  Yt(l»*),  then 


E[Xr]  =  r!/Ar,  k  =  0,1,2,...  (6.B.I.3) 


Indexing  the  sets  of  S      on  the  positive  integers 
so  that  8.  is  the  parameter  of  the  exponential  sojourn  time 

distribution  in  state  u.,  let  E   be  the  matrix  of  expectations 

(r) 

u.  .   of  sojourn  time  in  state  i  conditioned  upon  a  direct 
ij 

transition  to  state  j .   Then 


(r)       r 
vOjj   =  r!/6.,  if  i  adjacent  j, 
i«j        1 


and  is  not  defined  but  may  be  taken  to  be  0  otherwise 

The  matrix  M   of  weighted  moments  is 
r 


M   =  {yfr)  t..} 
r     ij   u 


where  the  transition  matrix  of  the  collapsed  process  is 


{tij' 


This  method  is  used  in  Section  VIII. B.l  to  generate 
numerical  spectral  representations  for  the  E(2,2;q,A_) 
process. 
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VII.   THE  DENSITY  OF  AN  ARBITRARY  INTERVAL  IN 
THE  SUPERPOSITION  OF  RENEV/AL  PROCESSES 

The  probability  density  function  of  an  arbitrary  interval 
in  a  superposition  point  process  can  provide  some  initial 
information  regarding  the  component  processes.   This  chapter 
examines  the  pdf  of  an  arbitrary  superposition  interval  as 
a  function  of  the  component  interval  probability  density 
function.   Although  the  material  presented  is  not  new,  it 
is  given  here  to  provide  an  added  characterization  of  the 
Erlang  and  hyperexponential  processes. 

In  Section  A,  a  general  component  process  interval  pdf 
is  assumed,  and  the  form  of  the  marginal  superposition 
density  is  determined.   It  is  shown  that  the  initial  value 
of  the  density  is  a  function  of  the  number  of  component 
processes. 

Sections  B  and  C  apply  the  results  of  Section  A  to  the 
E(k,p)  and  H(k,p;q,X^  processes,  respectively. 

VILA.   THE  ARBITRARY  INTERVAL  DENSITY  IN  THE  SUPERPOSITION 
OF  RENEWAL  PROCESSES 

The  purpose  of  this  section  is  to  derive  heuristically 

the  probability  density  function  of  an  arbitrary  interval 

in  the  superposition  of  p  iid  renewal  processes.   This 

result  was  originally  given  by  Cox  and  Smith  (195*0.  Let 

R(t)  =  Pr{X>t}  be  the  survivor  function  of  the  intervals  of 

of  the  component  renewal  processes,  with  associated  pdf  f(t). 


I83 


Then  the  equilibrium  excess  distribution  (forward  recur- 
rence time  distribution)  is  (Cox  and  Lewis,  1966) 


Z(t)  =  lim   Pr{time  to  next  event>t | event  at  u} 
u->- °° 


=  (E[X])  1      /   R(v)dv  . 
t 


The  length  of  an  arbitrary  interval  in  the  super- 
position process  is  the  minimum  of  the  time  to  the  next 
event  in  each  of  the  p  component  processes.   That  is,  if 
X  P   denotes  an  arbitrary  interval  of  the  superposition 
process , 


R(p)(t)  =  Pr[X(p)>t]  =   n   Pr[X,>t]  , 

j  =  l      J 


v/here  X.  is  the  time  to  the  next  event  in  the  j-th  component 
process . 

Let  s  be  the  index  of  the  component  responsible  for  the 
most  recent  event.   Then 


r 


Pr[X.>t]  = 

v 


R(t),   j  =  s   , 


Z(t),   j^S   , 


SO, 


R(p)(t)  =  R(t)Zp-1(t) 


(7.A.1) 


I8'i 


The  intervals  of  the  component  processes  have  pdf 


f(t)  =  -  jjjfct)  , 


so  the  pdf  of  an  arbitrary  superposition  interval  is 


f(p>(t)  .  -|f(P>(t) 


2 
=  (f(t)Z(t)  +  (p-1)  |T4^  }ZP_2(t)  .    (7. A. 2) 


The  initial  point  of  the  arbitrary  interval  density  is 
closely  related  to  the  number  of  component  processes,  as  can 
be  seen  from  the  following 

Theorem  VII.A.l:   Let  f(t)  and  f^(t)  be  as  defined  in 
this  section.   Then 

f(p)(0+)  =  f(0+)  +  (p-l)/E[X]  ,  (7. A. 3) 


and  in  particular,  when  f(0+)  =  0  and  E[X(p)]  =  1,  then 


f(p)(0+)  =  (p-l)/p   .  (7.A.1) 

Proof:   From  the  definition  of  Z(t)  as  the  survivor  function 
of  a  non-negative  random  variable  it  is  clear  that  Z(0)  =  1. 
Since  R(t)  is  also  the  survivor  function  of  a  non-negative 
random  variable,  R(0)  =  1.   Thus,  in  (7.A.2), 
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lim  f(p)(t)  =  f(0+)  +  (p-l)/E[X]  . 
t-»-0 

For  a  stationary  process,  E[X  ]  =  E[X]/p,  so  if 
E[X(p)]  =  1,  then  E[X]  =  p.  Hence  for  f(0+)  =  0,  and 
E[X(P)]  -  1, 


f(p)(0+)  =  (p-l)/p 


This  completes  the  proof  of  Theorem  VII. A. 1. 

The  final  form  of  this  result  is  related  to  a  similar 
result  of  Cox  and  Lewis  (1966,  Ch.  8).   Recalling  from 
(2.B.2.5)  that 


m£p)(t)  =  mf(t)  +  (p-l)m 


and  observing  that  as  t  grows  large  the  dependence  on  the 
arbitrary  event  diminishes  and  mf(t)  tends  toward  m,  so  that 


mi   (°°)  =  pm 


Thus  if  the  component  processes  have  mf(0+)  =  0,  then 


m^p)(0+)/m[p)(-)  =  (p-1)/p  .  (7. A. 5) 
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VII. B.   THE  ARBITRARY  INTERVAL  pdf  FOR  THE  E(k,p)  PROCESS 
In  the  E(k,p)  process,  the  component  interval  pdf  is 


Yt(k,A)  =  Xktk_1e-At/(k-l)!   .  (7.B.1) 


The  survivor  function  is 


Rk(t)  =  /   Yu(k,A)  du 

-1  k 
=  A  x   Z   y  (j,A)   ,  (7.B.2) 

3=1   r 


and  the  eauilibrium  excess  distribution  is 


Zk(t)  =  (A/k)   /   Rk(u)  du 

-1   k 
=  (Ak)  l      I       (k+l-j)  Yt(j,A)   .        (7.B.3) 

3=1 


Substituting  (7.3.1),  (7.B.2)  and  (7.B.3)  in  (7. A. 2) 
yields 

k 
.(p) 


(t)  =  (Yt(k,A)    Z  (k+l-j)  Yt(j,A) 


■   : 

j=l 


k 

+  (P-l)/(kA)[  z  yAlt\)T) 
J  =  i  b 

k  n_~ 

x  {  Z   (k+l-j)  Y.(j,A)}P  d       .     (7.B.1)) 
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Computation  of  the  pdf  may  be  simplified  by  implementing 
the  identity 

Yt(j,nX)  Yt(k}mA) 

f+kZi(  J'J!:i2)Yt(J+k-l3mA+nX)   .      (7.B.5) 


XnJ'mk      /j+k-2^ 


(n+m)' 


Thus  the  product  of  Erlang  probability  density  functions  is 
a  scaled  Erlang  pdf,  so  f/.   (t)  is  a  linear  convex 
combination  of  Erlang  probability  density  functions. 
Using  (7.B.5),  (7.B.4)  can  be  expressed  as 


f£P)(t)  -  (Xk)1_P{   Z   (k+l-j)  Y.(j,X)}p-2 
K  3=1  Z 


x  2X{_Z   2-(k+J')(k+l-j)  (k^-2)  Yt(J+k-l,2X) 


+  (P-D   2   *TJ  (^Ji2)  Yt(2j-l,2X) 


3-1     '  J' 


+  2(p-l)  V    Z        2"(J'+n)  (^k:2)Yf(J+n-l,2X)}  , 
3  =  1  n=3+l         V  3~1  J    Z 

(7.B.6) 


N 

S   a.Y,(j,p^)   ,  (7.B.7) 

3=1  J  t 


N 
where  N  =  p(k-l)+l  ,    E   a.  =  1   and  a.>0,  j=l,...,N. 

.1  =  1   J  3~ 


188 


Applying  Theorem  VII.A.l,  and  observing  from  (7.B.1) 
that  for  k>l}  Y0+(k,A)  =  0,  and  with  E[X]  =  k/X  ,  then 


f£p)(0+)  =  X(p-l)/k 


=  (p-l)/p  ,   for  X  =   k/p   .  (7.B.8) 

Applying  the  formula  (7.B.6)  to  the  E(2,2)  process 
yields 

f^2)(t)  =  {(l/2)Yt(2,2X)  +  (l/4)Yt(3,2A) 
+  (l/2)Yt(l,2X)  +  (l/4)Yt(3,2X) 
+  (l/2)Yt(2,2X)}/2 

=  (l/4){Yt(l,2X)  +  2Yt(232)  +  Yt(332A)} 

which  is  identical  with  the  probability  density  function 
derived  for  this  process  using  the  semi-Markov  generated 
point  process  representation  (6. A. A. 5). 

Using  (7.B.7)  and  Lemma  VI. A. 1,  the  r-th  moment  of  an 
arbitrary  interval  of  an  E(k,p)  process  is 

E[(X(p))r]  =   Z   (rl^j;   a.(pX)"r  .       (7.B.9) 
.1=1    U1  i;*    3 
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Thus, 


and 


t    \  N 

E[X^P;]  -  (pA)"1  Z      ja.   , 

J-l    J 


E[(X(P))2]  =  (pX)"2  I      J(J+l)a.   .  (7.B.10) 

J-l        J 


Recall  from  Chapter  III,  Section  A  that  in  direct 
computation  of  the  spectrum  of  intervals  of  an  E(k,p) 
process,  no  provision  was  made  for  evaluation  of  the  scale 
constant  Qx(k,p)  (3. A. 1.22).   Cox  and  Lewis  (1966,  pp.  73) 
relate  the  initial  points  of  the  count  and  interval  spectra 
of  a  stationary  point  process,  given  in  equation  (2, A. 3-2) 
and  expressed  here  in  the  notation  of  superposition  processes, 


g{p)(0+)E[X(p)]  =  f[p)(0+)C2(X(p))  ,         (7.B.11) 


where  C(X  p  )  is  the  coefficient  of  variation  of  an 
arbitrary  interval  of  the  superposition.   Equation  (3.C.8) 
gives  the  initial  value  of  the  E(k,p)  count  spectrum  to  be 


g{p)(0+)  =  pX/(k2^)  (7.B.12) 


Now  (7.B.10),  (7.B.11)  and  (7.B.12)  can  be  used  to  determine 
the  initial  point  of  the  interval  spectrum,  and  thus  provide 
the  information  necessary  to  evaluate  Q,(k,p)  in  terms  of 
the  polynomial  ratio  representation  presented  in  Chapter  III 
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In  Chapter  VII,  the  computational  details  are  described^ 
and  pdf's  for  several  values  of  k  and  p  are  displayed  v:hich 
Illustrate  the  results  of  Theorem  VII.A.l,  along  with  other 
more  qualitative  features. 

VII.  C.   THE  ARBITRARY  INTERVAL  DENSITY  OF  THE 
H(k3p;o_,A)  PROCESS 

The  component  interval  density  in  the  H(k,p;q.A_)  process 

is  given  by 


f(t)  =  Z      q.X.  exp{-A.t}  ,  (7.C.1) 

J-l   J  J 


with  corresponding  survivor  and  equilibrium  excess 
distributions 


k 
R(t)    =      I      q,    exp(-X.t)  (7.C.2) 

j-l      J  J 


ar.d 


where 


k 
Z(t)    =    (1/E[X3)       I      q.    exp{-A    t}/A      ,  (7.C.3) 

j-l      J  J  J 


E[X]    =       I      q,/X       .  (7.C.4) 

j=l      J       J 


Using  (7.C1)  through  (7.C.4)  in  (7. A. 2)  gives  the 
density  of  the  arbitrary  superposition  interval  for  this 
process : 
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/  n        k   k       /"A.        \  -X.  +  X    )t 
j=l  n=l   J   \  n       / 


Inspection  of  (7.C.5)  reveals  that  f  p  (t)  is  also  hyper- 
exponential  and  can  be  put  in  the  form  of 


f^p;(t)  =   Z    Z.\i.    exp{-y.t}   , 
J  =  1    J  J       J 


where 


=(T)(k;^3) 
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VIII.  NUMERICAL  RESULTS 

Throughout  the  course  of  this  research,  considerable 
effort  was  expended  in  performing  the  computational  proce- 
dures outlined  in  the  various  sections  of  this  thesis.   The 
reasons  for  this  effort  were 

1.  To  verify  the  methodology  by  comparing  results  of 
varying  approaches  to  the  same  problem; 

2.  To  establish  the  various  procedures  as  practical 
methods  of  obtaining  answers  to  particular  questions; 

3.  To  provide  a  basis  for  comparison  between  the  various 
methods ,  and 

4.  To  provide  qualitative  means  of  distinguishing  the 
processes  studied,  and  in  particular  tabulate  the 
forms  of  the  spectra  and  serial  correlations  for  small 
p  and  k. 

Chapter  III  was  devoted  primarily  to  deriving  an  analytic 
representation  for  the  spectrum  of  an  E(k,p)  process. 
Section  A  of  this  chapter  describes  two  methods  of  evaluating 
that  representation.   Included  in  the  section  is  a  brief 
description  of  the  FORMAC  algebraic  manipulation  preprocessor 
which  has  proved  useful  in  several  situations. 

Chapter  V  developed  a  method  for  computing  the  spectrum 
of  a  semi-Markov  generated  point  process  which  involves 
determining  the  inverse  of  a  matrix  (Ie   -T),  where  co  is 
the  spectral  argument.   In  Section  B  three  methods  of  solving 
this  problem  are  presented,  each  of  which  has  been  used 
successfully  In  analyzing  the  interval  spectrum  of  various 
E(k,p)  processes  which  have  been  given  semi-Markov  generated 
point  process  representations. 
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A  computational  form  for  the  probability  density  function 
of  an  arbitrary  interval  of  an  E(k,p)  process  was  derived  in 
Chapter  VII.   Section  C  describes  implementation  of  the 
method,  including  comparisons  of  certain  specific  values  with 
those  same  values  determined  through  spectral  analysis. 

Section  D  contains  a  brief  discussion  of  the  interval 
bispectra  of  E(k,p)  processes  modeled  as  semi-Markov 
generated  point  processes. 

Use  of  the  Fast  Fourier  transform  to  determine  the 
sequence  of  serial  correlations  of  a  point  process  from  the 
spectral  density  is  discussed  in  Section  E. 

In  Section  F  the  computation  of  the  second  order  count 
spectrum  of  an  E(k,p)  process  is  presented. 

Throughout  the  chapter  we  give  numerous  graphs  and  tables 
which  illustrate  the  properties  of  the  functions  being 
studied  and  provide  a  basis  for  comparison  between  processes. 

Computer  programs  used  in  this  analysis  are  listed  in 
Appendix  E . 

VIII. A.   DIRECT  COMPUTATION  OF  THE  SECOND  ORDER  E(k,p)  SPECTRUM 

Lewis,  et  al  (1973,  Sect.  5),  and  Chapter  III  of  this 
thesis  discuss  in  detail  the  representation  of  the  interval 
spectrum  of  an  E(k,p)  process  as  proportional  to  the  sum  of 
the  ratios  of  trigonometric  functions  (3. A. 22),  wherein 
Q^(k,p)  Is  defined  as  the  constant  of  proportionality. 

Two  methods  of  evaluating  (3. A. 1.22)  have  been  developed. 
The  first,  developed  by  W.  J.  Hayne ,  (See  Lewis,  et  al,  1973) 
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evaluates  the  summation  numerically  for  a  finite  set  of 
values  of  to.   The  second,  developed  to  supplement  this 
research,  makes  use  of  the  symbolic  manipulation  capabilities 
of  FORMAC  (Raney,  1973)  to  determine  an  exact  formulation 
as  the  ratio  of  finite  polynomials  in  cos  to,  as  expected 
from  Theorem  III. A. 2. 

VIII. A. 1   Numerical  Approximation  of  the  E(k,p) 


Interval  Spectrum 


The  computational  form  of  the  second  order  spectrum 
of  the  E(k,p)  process  is  (3. A. 1.22) 


i    \              t  -i       nP  k       k  2a , 

.r(P)/   \     n  /-i    \   (1-COS  M)           v         v  J 

fr^'CuO  =  Q,(k,p)  5- E  •••  E    — 5 5 

A        Ak^P    J1=l   J  =1  (aj+b})Cj 


(8. A. 1.1) 


with  J,  a,,  bj  and  Cj  as  defined  in  (3. A. 1.23).   A  direct 
numerical  evaluation  of  (8. A.  1.1)  was  implemented  in  a 
FORTRAN  program,  SPECD.   The  program  was  used  by  Lev/is,  et 
al .  (1973)  in  the  preliminary  research  of  the  Erlang 
superposition  process. 

The  following  procedure  was  followed  by  SPECD: 
a.   Enumerate  the  distinct  sets 

1  ■{J1»...»Jp>»   3^1, ...,k;  i  =  l,...,p 

by  setting  j.,=l,  1=1,..., p,  and  incrementing  the  indices  so 
as  to  maintain  the  inequality  j.  <_  j,  ,  for  j  <  k. 
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b.   For  each  value  of  oj  chosen  uniformly  between  0  and  it, 
and  each  set  J,    evaluate 


2|j|a 


J 


(aj+bj)Cj 


where  |j|  represents  the  number  of  distinct  permutations  of 
the  elements  of  J. 


c.  For  each  to,  set 

U(M)  -  (1  -  c0***      l^fy-  (8. A. 1.2) 

Ak^p     J  (aj+b^)Cj 

d.  Use  quadratic  extrapolation  to  evaluate  U(o)  and  U(tt). 

e.  Since  the  integral  of  f|-  (oj)  must  equal  1,  and 
f|p)(oj)  =  Qx(k,p)U(w),  approximate  Qx(k,p)  by 

N        -1 
Qi(k,p)  =  {(tt/N)  z     U(w,)}    ,  (8.  A.  1.3) 

A  3=0    J 

v:here    u.  =  tvj/K. 

f.  Set  fjp)(co.)  =  Q,(k,p)U(u.)  .  (8. A. 1.1) 


Some  additional  information  available  from  this  program 

is  the  variance  and  coefficient  of  variation  of  an  arbitrary 
interval.   Using  the  relation 

gjp)(0+)  =  pA/(k2Ti)  (8.  A.  1.5) 
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and 


gjp)(0+)E[X(p)]  =  fjp)(0+)C2[X(p)]  ,  (8. A. 1.6) 

previously  given  as  (3.E.6)  and  (7.B.11),  where  X 
represents  the  interval  following  an  arbitrary  event  in  the 
superposition  process,  yields 

c2[x(p)]  =  (f|P)(0  +  )k7T)-1   ,  (8. A. 1.7) 

and 

V[X(p)]  =  {k/(p2X2TTf|p)(0+))}  .  (8. A. 1.8) 

Figures  VIII. A. 1  through  VIII. A. 10  are  comparative 

spectral  density  representations  of  the  various  E(k,p) 

spectra  generated  by  the  foregoing  method. 

VIII. A. 2   Analytic  Determination  of  the  E(k,p)  Interval 
Spectrum 

This  phase  of  the  research  made  use  of  an  algebraic 

manipulation  routine,  FORMAC,  to  compute  a  condensed  formula 

of  the  second  order  interval  spectrum  for  specific  values  of 

k  and  p.   Theorem  III. A. 2,  guaranteeing  that  the  interval 

spectrum  of  an  E(k,p)  process  was  that  of  a  mixed  auto- 

regressive/noving  average  process,  required  examination  with 

regard  to  confirming  the  estimates  of  the  order  of  the  process 

as  proposed  in  Section  III.D. 
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1 

IT 


spectra,  f'w(io),  for  E(2,p) 


+, 


Figure  VI I I.A.I 
superposition  processes,  o=2, 

f|p)(.)  =  £ 

Note  that  for  k=2,  the  spectrum  is  fairly  flat  with  a  notch 
developing  near  the  origin  with  increasing  p,  as  the  initial 
point  of  the  spectrum  approaches  its  asymptotic  value,  1/kTT. 
There  is  a  relative  peak  at   go=tt  (period  T=2)  representing 
the  quasi-alternatioh  between  events  from  the  two  processes 
for  p=2. 


,8.  'The  squares  at 
represent  the  flat  spectrum  of  a  renewal  process 
k=2,  the  spectrum  is  fairly 
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Figure  VIII. A. 2   Interval  spectra  for  the  E(3,p)  super- 
position process,  p=2,...,8.   The  squares  of  1/tt  represent 
the  flat  spectrum  of  a  renewal  process.   Note  the  hunps 
in  p=2,3  and  1  spectra  centered  at  ir(T=2),  2tt/3(T=3)  and 
tt/2(T=4)  respectively. 
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Figure  VIII. A. 3   Interval  spectra  for  E(^,p)  superposition 
processes,  p=2,...,6.   The  crosses  at 

f+   (u)  =  -  represent  the  flat  spectrum  of  a  renewal  process 

As  in  previous  cases,  relative  peaks  at  periods  p  appear  in 
the  spectrum  diminishing  in  amplitude  as  p  increases  and  the 
spectrum  approaches  the  flat  spectrum  of  the  Poisson  process 


POO 


h 


t<»\») 


;xxxxxxxxxx 


<xxxxxxxxxx 


v/H      tt/3 


tt/2 


27T/3 


3V4 


8 


H 

6 


0) 


Figure  VIII.  A.  *J   Interval  spectra  for  E(5,p)  superposition 
processes,  p=2,3»^«   The  crosses  at 

f,p  (to)  =  —   represent  the  flat  spectrum  of  the  renewal 

process.   In  addition  to  the  relative  peaks  exhibited  in 
previous  plots,  a  secondary  peak  can  be  seen  at  T=p/2  for 

the  E(5,*0  process.   As  in  previous  figures,  f+   (0+) 

decreases  monotonically  toward  1/lcrr  as  p  increases. 
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Figure  VIII. A. 5   Interval  spectra  for  the  E(6,p) 
processes,  p=2,3,^.   The  crosses  are  as  in 
previous  figures.   As  in  the  E(5,^)  process,  a 
second  peak  at  T=p/2  appears  in  the  E(6,p) 
process,  probably  representing  an  harmonic. 
The  main  peaks  are  at  periods  T=p . 


fjp)(w) 
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Interval  spectra  for  the  E(k,2) 
.  , 8  .   The  crosses  at 


(w)  =  1/tt  are  as  in  previous  figures 


Note 


Figure  VIII. A. 6 
processes,  k=2, 

f(p) 

+ 

the  sharp  peak  at  co=tt  representing  a  period  of  2 
and  Increasing  as  k  increases .   This  is  because 
the  intervals  in  the  component  processes  become 
less  dispersed  as  k  increases  (coefficient  of 
variation  decreases,  Fig.  VIII. C.l),  and  the 
alternation  of  component  events  in  the 
superposition  becomes  more  pronounced. 


f|p)(c) 


X   X   X   X  X   X   X  X   X   X 


h 


it/3 


8 


t 


TT/2 

1— 


2TT/3  3^/^ 

—i 1 — 


f:'l 


-• 


"T" 


+- 
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Figure  VIII 
k=2,  ... ,8.   The 
peaks  at  u=2it/3 
increasing  with  k 


A. 7   Interval  spectra  for  the  E(k,3)  processes, 
crosses  are  as  in  previous  figures.   The 
corresponding  to  a  period  T=3,  clearly  are 
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x  x  x  x  x  x  x  x 


tt/A      tt/3 


tt/2 
i 


2tt/3    3-tt/2^ 
— I 


T 


Figure  VIII. A. 8   Interval  spectra  for  the  E(k,^)  processes 
k=2,...,6.   The  crosses  at  1/tt  as  before.   With  p  even, 
v/e  see  the  indication  of  an  harmonic  peak  at  period 
T=p/2=2,  becoming  more  pronounced  as  k  increases. 


?(,[, 


flp)(w) 


k=4 


xxxxxxxxxxxxx 


tt/3 


tt/2 


2tt/3   3^t/^ 


0) 


Figure  VIII. A. 9   Interval  spectra  of  the  E(k,5)  processes, 
k=2,3,^.   The  crosses  as  before.   Here  we  see  a  rcain  peak 
at  T=5,  u=2t;/5,  in  the  E(4,5)  process,  a  secondary  peak  is 
apparent  at  T-5/2,    =  Uti/5.   '  These  peaks  would  be  expected 
to  becorr.e  r.ore  pronounced  as  k  increases  . 
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xxxxxxxxxxxxxx 


tt/4      tt/3 

— h +- 


2tt/3    3-tt/^ 
-H f— 


w 


T 


I. A. 10      Interval   spectra    for   the   E(k,6)    processes, 
crosses    at    1/tt   as   before.      Here    the   main  oeak 


k=2,3,^.   The 


is  at  w=tt/3  (T=6=p)  with  a  secondary  peak  at  2tt/3(T=p/2)  for 
the  E(^,6)  process. 
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While  such  computation  is  not  difficult  to  do  by  hand 
for  k=2,  and  p=2,  3  or  4  (Fig.  VIII. A. 11)  the  magnitude  of 
the  coefficients  (in  Integer  form)  and  the  number  of  terms 
involved  for  larger  values  of  k  and  p  renders  hand  calcula- 
tion virtually  impossible.   However,  integer  calculations 
were  required  so  that  differentiation  between  zeroes  and 
very  small  numbers  would  be  possible. 

Subdivision  VIII. A. 2. a  contains  a  description  of  the 
problem  in  such  a  way  that  an  algebraic  solution  is  feasible. 
In  Subdivision  VIII. A. 2. b  wer  give  a  brief  description  of 
PORMAC  outlining  those  features  which  make  it  suitable  for 
this  problem,  along  with  the  drawbacks  which  limit  is 
usefulness . 

VIII. A. 2. a   Problem  formulation 

To  solve  algebraically  for  the  interval  spectrum  of  an 
E(kjp)  process,  begin  with  the  formulation  of  Chapter  III, 
Section  A,  given  by  equation  (3. A. 2. 4) 

(p)/..x  -  a  „.  „n  (1-OOS  C0)P   yfl    )v  2*L 


r;*"<»)  =  Qx(k,p)  —*->       i[r 


Ak 


HVE     -T-i —   ' 

t   l  LeRt     (a£+b£)cL 


v/he 


re,  it  will  be  remembered,  R.  is  an  index  designation 
vector  with  elements,  L    ,    which  are  distinct  permutations 
of  the  same  set  of  integers.   (The  sets  V     "        (p),  as  defined 
in  Section  III.D,  are  used  in  place  of  the  index  designation 
vector,  R  ,  when  k  is  even.   The  conversion  Is  tedious  but 
straightforward,  and  discussion  will  be  omitted.) 
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The  general  procedure  to  be  followed  Is  to  enumerate 
the  Index  designation  vectors,  (R^),  and  form  the  sum 

2a 
S.(w)  =  I  5-^5 (8. A. 2. 2) 

r      LeRt   (a[+b[)cL 

for  each  R,  .   Each  sum,  S.(oj),  is  then  placed  over  a  common 
denominator,  so 


St(u)  =  LTt(co)/Dt(aj). 


?he  terms  N.  (co)/D.  (u)  are  combined  to  form 

s(o)  .  ik£OBa)!   z    p     J —      ,  (8. a. 2. 3) 

Xk2p    t  VRt^  u  (U) 


which  again  is  placed  over  a  common  denominator. 

Finally,  using  the  known  value  of  f|p'(0+),  (Equation 
(7.B.11))   Q,(k,p)  is  determined  from  the  equation 


fjp)(0+)  =  QA(k,p)  S(0+)   .  (8. A. 2. 4) 


The  actual  procedure  is  most  easily  explained 
through  an  example: 

Example  VIII.A.l:  The    interval    spectrum   of 
the   E(Z,Z)    process.      The  class  of  all  index  designator  sets, 
Rt,  can  be  operationally  defined  by 
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k 


{Rt>  =  {(n1, .  .  .  ,nk)  |p_>n,>n    >0,j  =  l,  .  .  .  ,k-l;  I   n,=p} 

(8. A. 2. 5) 
For  the  E(3,3)  process 

{Rt}  ■  {(3, 0,0), (2, 1,0), (1,1,1)} 


—  {R-ij  Kpj  L) 


Recalling  the  definition  of  St(w)  (8. A. 2. 2),  and  the 
results  of  Lemma  III.A.l,  as  expressed  in  (3- A. 2. 5), 
(3- A. 2. 7),  (3- A. 2. 8)  and  (3. A. 2. 9), 


3 


2ttJ  +  co,  •  3 


Sn(«)  ■  (1/3)  I  U-cos(^pi)} 


(1/3)   S   [  n  {l-cos(i2I^)}]3 
,1  =  1   m/J I 

{2"2(l-cos  oj)}P 


(8. A. 2. 6) 


At  this  point  a  FORMAC  program  must  be  written  which 
is  tailored  to  the  specific  problem.   Using  the  identities 
expressed  in  (3. A. 2. 12)  and  evaluating  the  sine  and  cosine 
terms,  the  numerator  of  S,  (oj)  becomes 

U1(u)   =    [2+cosU/3)  -  3sin(a)/3)][l-cos( o)/3)] (1/2) 

+  [2+cos(u)/3)  +  3sln(w/3)][l-cos(a)/3)](l/2) 

+  [2+cos(u/3)  -  3sin(u)/3)][2+cos(u/3)  +  3sin(w/3)] 

( 8 .  A  .  2  .  7 ) 
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which  is  easily  evaluated  by  PORMAC.   Substituting  the 
appropriate  identities  from  Appendix  B  results  in 


(w)  =  3(139  t   100  cos-"  %   !!  cos2o))  (8. A. 2. 8) 


(1  -  cos  to) 


Similarly. 


_            ,_  ~       27n'+to           2-rm+Ww,            2ttj+uk-2,,  2irm+a;N-2 

3  ( 3-2cos — ^ cos — = )  ( 1  -  COS ± )      ( 1  -  CCS — = — ) 

S    ( co )    =      E      E    - - -      - 

2  .    ,   tA~7n  c        2ui+u     I        2irj+cj  2Ti(m+,i  )+cjn 

j=l  m^j(7-6cos — ^ 3cos — % — +2ccs —   " — ) 

d        J  J      (8. A. 2. 9) 

is  evaluated  in  a  specially  constructed  FORMAC  program,  using 
appropriate  trigonometric  identities,  and  becomes 


o  /  n    ^4(1^27^  +  2^3Qcos  to  -  Ol8cos2u  +  8lcos3co) 

Ci^\Ui  ) p p 

(1-cos    u)^(27cos    oj+169) 


(8. A. 2. 10) 


The  index  designator  set  R^  represents  a  single  element 
which,  when  evaluated  as  above  gives 


S0(w)  -  ^^ 2 r  (8. A. 2. 11 

3      3U-cos  to) 


Substituting    (8. A. 2. 8),  (8. A. 2. 9)  and  (8. A. 2. 11)    in 
(8. A. 2. 3)    yields    the    final    form  of  S(u>): 

S(w)    =    (1-cos    oj)3{S1(w)  +  3S2(oj)  +  6S3(oj)}/A36 

(2^9873+l'i?020cos  co-22389co3?t.H-l7i)96cos3wH'i;0rosl4w) 


(l69+27cos2aOA 


(8. A. 2. 12) 
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Using  the  results  of  Chapter  VII  (7.B.10)  and 
(7.B.12)  as  Implemented  in  Section  3  of  this  chapter  yields 

g|3)(0+)  =  X/(3t0  , 


r2ry(3)n  _  3983 
C  LX    J  "  63&T  ' 

and 

E[X(3)]  =  l/X  .  (8. A. 2. 13) 


Using  (8. A. 1.6)  and  (8. A. 2. 13)  gives  the  result 
fj3)(C+)  =  (X/3w)(l/X)/(3983/656l) 


(3983)(3  )     •  (8.A.2.14) 


Evaluating  (8.A.2.12)  at  co=0  and  using  it  along  with 
(8. A. 2. 1*0,  gives  the  scale  factor  Q,(3,3): 


QX(3»3)  -  39^  (8. A. 2. 15) 


Thus  the  final  expression  for  the  E(3,3) 
interval  spectrum  becomes 


S^/.J-l  7 kCif^nc  3t.A.r-l\Prr\c^ i 


■•  r    '• 


r(3),    x    _     3(2^?873+l;i2C20cos  o>-22389cos^l7^6cos:iu^6^8( 
+      Cw)    "     ?  x„r._ ■ 

(8.  A. 2. 16) 


(169+27cos2u)3983tt 
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This  completes  Example  VIII. A. 1.   However 
reference  will  be  made  to  this  example  in  the  following 
section.   Exact  results  for  processes  evaluated  in  this 
manner  are  tabulated  in  Figure  VIII. A. 11. 

Recall  that  the  order  of  an  ARMA(m,n)  process 
Is  reflected  in  the  degree  of  the  cosine  polynomials  in  the 
spectral  representation.   In  the  case  of  the  E(3,3)  process, 
the  similar  process  is  an  ARKA(2,4)  process,  giving  a 
spectrum  whose  numerator  is  a  cosine  polynomial  of  degree  k 
and  whose  denominator  is  a  cosine  polynomial  of  degree  2. 
Note  that  not  every  ARMA(2,4)  process  is  similar  to  the 
E(353)  process;  only  the  one  whose  spectrum  is  given  by 
(8. A. 2. 16) . 

An  important  feature  of  the  results  tabulated 

in  Fig.  VIII. A. 13  is  their  consistency  with  the  degree  of 

the  similar  AFJ-IA  processes  tabulated  in  Figure  III.C.l. 

VIII. A. 2. b.   The  FORKAC  algegraic  manipulation 
preprocessor 

"FORKAC  (FORmula  HAnipulation  Compiler) 
provides... a  tool  for  performing  symbolic  manipulation 
of  mathematical  expressions  along  with  the  usual 
features  of  a  numerical  mathematical  language... 
Expressions  to  be  manipulated  can  contain  variables, 
user-defined  functions,  constants,  symbolic  constants 
and  functions.   Expressions  can  be  differentiated, 
evaluated,  replaced,  compared  and  parsed."1 


1Raney  (1973,  pp.  i) 
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Figure  VIII. A. 11   Algebraic  representations  as  ratios  of 
cos  to  polynomials  of  the  second  order  interval  spectra  of 
certain  Erlang  superposition  processes.   The  expressions 
given  for  each  spectrum  are  denoted  N,  D  and  Q.   The 
spectrum,  is 

f+(co)  =  QN/  D 

Those  processes  marked  with  an  asterisk  were  computed  by 
Lev/is,  et  al.  (1973)  . 

The  computational  difficulty  associated  with  this  computation 
is  Illustrated  by  the  resultant  formula  for  the  E(4,4) 
interval  spectrum. 

These  were  computed  by  hand  for  small  k  and  p,  and  with 
FORMAC  assistance  for  higher  k  and  p. 

E(2,2)  process*       {ARKA( 1 , 0)  spectrum) 

M  =  1  -  cos  co 
D  ■  1 
Q  =  1/5 

E(2,3)  process-       {ARMA(2,1)  spectrum) 

N  =  121  -  48  cos  oo  -  9cos2co 
D  =  ■Ul  -  9  cos  co 
Q  =  9/25 


E(2,lJ)  process*      {ARI'A(3,D  spectrum) 

N  =  871  -  502  cos  co  -  57  cos2co  -  21  cos^co 
D  =  17  -  8  cos  co 
Q  =  8/379 

E(3,2)  process        {ARMA(2 ,1)  spectrum) 

N   =    39^2  +    22^1    cos   u  +    378   cos2co 
D  =    65   +    16    cos   co 
Q  =    1/1495 
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Figure   VIII. A. 11    (continued) 

E(3,3)    process  {ARMANI, 2)    spectrum} 

N  =    249,873   +   142,020   cos    co  -   22,389    cos2u 

+   17,496   cos3u  +   648    cos^u 
D  =   169   +    27    cos2u 
Q  =    3/3983 

E(4,2)    process  (ARMA(2,1)    spectrum} 

2 
N   =    31   -    cos    co 

D   =    3   +    cos    to 

Q   =    256/3^95 

E(4,3)    process  {ARKA(5,3)    spectrum} 

N   =    182,141,315,652,508   -    78,862,095,096,808    cos    oj 

-  42,822,137,630,712    cos2cu   +    25,599,977,898,816    cos3co 
+    207,765,000    cos^co 

D   =    43,835,592,913   -    19,552,361,549    cos    co 

+    19,683,026,163    cos2co   -    4,100,625    cos3co 
Q  -    6561/8,913,904 

E(4,4)  process        {ARMA(8,5)  spectrum} 

N  =  310,464,417,651,734,009/8 

+  (1/8)11,776,887,383,690,599,849  COS  CO 
+  (1/8)25,218,699,913,699,885,013  cos2co 
+    (1/8)21,251,879,278,015,791,883    cos3co 

-  1,060,176,380,434,254,459    cos^co 
+    426,910,575,503,195,072    cos5co 

+    544,710,307,072,237,568    cos6co 

+    17,367,184,018,767,872    cos7co   -    1,090,519,040,000    ccs8co 
D   =    230,024,100,214,001   -    64,640,820,663,704    cos    u 

+    115,164,588,505,856    cos2co   +    75,974,636,240,896    cos3co 

-8,481,012,711,724    cos   w  -    335,554,320,000    cos^co 
Q  =   1,556, 391, 325, 136xl010/833, 625, 450, 472, 186, 167, 743, 918, 509 
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Figure  VIII. A. 11  (continued) 

E(5,2)  process       {ARMA(3,2)  spectrum} 

N  =  4,043,205  -  47,553  cos  oj  -  224,126  cos2oj  +  9,728  cos3oj 

D  =  1,174,529  +  720,192  cos  u  -  4,096  cos2oj 
Q  =  160/679 
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The  above  description  summarizes  the  properties 

of  PORMAC.   The  specific  capabilities  of  PORMAC  which  loaned 

themselves  to  this  phase  of  the  research  were 

1.)   Ability  to  maintain  formula  integrity.   That  is,  to 
keep  track  of  variables  in  symbolic  form  so  that 
the  contribution  of  each  parameter  to  the  final 
result  is  directly  apparent. 

2.)   Ability  to  perform  polynomial  multiplication. 

3.)   The  capacity  to  maintain  extensive  formulae  in  exact 
form.   Integer  coefficients  can  have  up  to  2295 
digits,  while  formula  length  is  only  limited  by  core 
storage  available  to  the  program. 

k.)      The  capability  of  implementing  simplifying  substitu- 
tions, as  for  example,  the  trigonometric  identities 
of  Appendix  B. 

In  evaluating  expressions  of  the  form  shown  in 

(8. A. 2. 9)  the  identity 


cos( — £ — )  =  cos(2irj/k)cos(u/k)  -  sin(2iTj/k)  sin(w/k) 


was  used  to  isolate  the  variable  terms  cos(co/k)  and  sin(co/k). 
For  many  values  of  j  and  k,  there  are  no  rational  equivalents 
to  cos(2iTj/k)  and  sin  (2Trj/k)  .   Thus,  to  ensure  that  cancel- 
lation of  terms,  where  it  occurred,  would  not  be  masked  by 
numerical  Imprecision,  and  conversely,  not  be  indicated  by 
very  small  coefficients,  the  terms  cos(2Trj/k)  and  sin(2iTj/k) 
were  retained  as  symbolic  entities. 

Equations  (8. A. 2. 9)  and  (8. A. 2. 12)  illustrate 
the  need  for  polynomial  multiplication.   There  S„(co)  is  the 
sum  of  polynomial  fractions  in  sin(w/3)  and  cos(w/3).   Each 
step  of  the  procedure  which  expresses  S?(oj)  as  a  single 
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polynomial  fraction  requires  multiplication  of  polynomials 
and  collection  of  like  terms.   At  the  same  time,  these 
polynomial  products  involve  many  terms  in  various  combina- 
tions of 

sinr(2^j/k)coss(27Tm/k)cost(w/k)sinv(w/k)        (8.  A.  2. 17) 

which  must  be  maintained  in  their  entirety  until  simplifying 
relations  can  be  imposed. 

The  method  of  generating  the  compact  form  of  the 
spectrum  of  an  E(k,p)  process  is  iterative  in  nature.   It  is 
not  clear  at  the  outset  which  trigonometric  identities  will 
reduce  the  complicated  formulae  to  the  desired  form.   The 
problem  must  first  be  run  without  substitutions  of  any  kind. 
Based  on  the  results  of  the  preliminary  run,  a  set  of 
substitutions  designed  to  convert  sin  v(co/k)  to  (1-cos  (co/k))v 
and  all  symbolic  coefficients  of  cos  (to/k)  and  sin  v~  (co/k) 
to  rational  numbers.   (It  is  not  clear  that  this  is  always 
possible,  but  it  was  worked  out  for  those  cases  actually 
considered.)   The  final  stage  requires  the  conversion  of 
cos  (u/k)  to  cos(tw/k).   At  this  step,  correct  formulation, 
correct  substitution  and  Theorem  III. A. 2  guarantee  the 
cancellation  of  terms  for  which  t  is  not  an  integral 
multiple  of  k. 

Two  serious  drawbacks  to  this  procedure  exist. 
First,  the  FORHAC  analysis  is  extremely  demanding  in  terms 


218 


of  computer  space  and  time.   A  final  run  for  the  spectrum  of 
the  E(5,2)  process,  once  the  appropriate  substitutions  had 
been  determined,  required  378000  bytes  of  storage  and  73 
minutes  of  central  processing  unit  time  on  the  IBM  360/67 
computing  system. 

The  second  drawback  is  in  determining  the  first 
stage  substitution  requirements  and  substitution  identities. 
As  can  be  seen  in  (8. A. 2. 17),  a  great  many  combinations  are 
possible.   In  the  E(5,2)  analysis,  with 

a-,  =  cos(2tt/5  )  = -cos  (  3tt/5)    =  -  cos(7tt/5)    =  cos(8ir/5) 

b,  =  sin(2TT/5)    =    sin(3ir/5)    ■  -  sin(7Tr/5)    -  -   sin(8iT/5) 

a?  =  003(^11/5)    =    cos(6it/5)    =  -  cos(9tt/5)    =  -   cosOr/5) 

b2  =  sin(4iT/5)    =   -    sin(oTr/5)  =  -   sin  (9^/5)  =    sin(ir/5) 

some  typical  substitutions  were 


b^b2a^ax  -  b^a^  =  -  5/26 


a2+a2  =  3/22 


(a1a2b1b2)2  =  5/28   . 


All  of  the  above  forms  were  derived  from  the  basic  identities 

al  +  a2  =  ~1/2   » 
and 

al  =  2a2  -  !  =  !  ~  2b2   • 
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In  all,  41  substitutions  were  required  for  the 
second  stage  computations.   The  number  of  such  substitutions 
increases  rapidly  with  k  and  p,  along  with  the  complexity  of 
the  terms,  the  time  and  the  space  required  for  the  computations 
Using  this  method  on  a  process  such  as  the  E(7,3)  process  is 
virtually  impossible. 

VIII. B.   THE  INTERVAL  SPECTRUM  OF  THE  SEMI-MARKOV 
GENERATED  POINT  PROCESS 

The  interval  spectrum  of  a  semi-Markov  generated  point 
process,  as  shown  in  Chapter  V,  (5.B.5)  involves  the  inverse 
of  the  matrix  (Iu-T).   In  order  to  form  a  workable  expression 
for  the  spectrum,  a  practical  method  for  performing  the 
inversion  of  a  matrix  containing  a  variable  term  is  required. 
Three  methods  have  been  investigated  for  this  purpose.   The 
methods  are  designated  algebraic  inversion ,  diagonalization 
and  numerical  approximation . 

Subsection  VIII. B.l  details  the  method  of  algebraic 
inversion,  by  which  a  modified  Gauss  elimination  written  for 
the  FORMAC  preprocessor  was  used  to  find  (Iu-T)~   directly. 

Subsection  VIII. B. 2  describes  the  use  of  diagonalizing 
matrices  P  and  P~   to  find 


-ln-1 


(Iu-T)-1  =  P(Iu-D)_1P 


where  D  =  P   TP  is  a  diagonal  matrix, 
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Subsection  VIII. B. 3  contains  an  explanation  of  the  use 
of  equation  (5.B.12)  to  generate  a  numerical  approximation 
of  the  Interval  spectrum.   In  this  method,  the  summation 


CO 

Z      it'pM1  (TJ"1-T°°)Mnlcos  J« 
3-1 


=   Z   tttM ,(TJ"1-T°°)M  T_cos  jw 


with  the  error  decreasing  geometrically  with  N. 

VTII.B.l   Algebraic  Inversion  of  (Iu-T) 

The  method  of  direct  algebraic  inversion  relies  on  the  . 
theory  of  integer  preserving  Gaussian  elimination.   (See 
for  example  Bareiss  (1968)) 

The  procedure  is  this: 

To  the  matrix  (Iu-T),  and  an  identity  matrix  of  the  same 
dimension,  apply  a  sequence  of  identical  transformations 
which  will  transform  (Iu-T)  to  an  identity  matrix.   Then  the 
matrix  which  results  from  the  sequence  of  transformations 
applied  to  the  identity  matrix  will  be  (Iu-T)~  .   In  the 
iterative  Gaussian  procedure,  denote  the  state  of  the 
original  matrix  after  it  has  been  operated  upon  n-i  times 
by  {a^ .    },  and  the  correspondingly  transformed  identity 
matrix  by  Cb^1?"1^}  . 

Let  d   =a      ,  n=l,...,m;  d    =1,  where  m  Is  the 

nn    3 

dimension  of  the  matrix  T.   Then  for  i/n, 
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aiJ}  =  (^"^d^^a^-^a^^/d^-15        (8.B.1.1) 
blf   =  Cbij"1)d(n)-b^-1)ag-1))/dCn-1)        (8.B.1.2) 


and 


a(n)  _  a(n-l)   .   h(n)  _  h(n-l)  ,ft  R  ,  m 

anj   "  anj      '   bnj    bnj  (B.B.I. 3) 


Two  important  features  of  this  computation  are, 
from  Fox  (1965,  Ch.  3) , 

a.  The  term  d^n_1^  divides  the  terms  of  (8.B.1.1) 
and  (8.B.1.2)  exactly,  and 

b.  If  (Iu-T)  is  of  order  m,  then  d^m'  is  the 
determinant  of  (Iu-T),  and  {b..  }  is  the  adjoint.   That  is, 
if  B  =  {b?r!l)},  then 


(Iu-T)"1  =  B/d(m)  (8.B.1.4) 


Although  the  divisibility  property,  a,  is  easily 
verified,  it  must  be  remembered  that  d    is  a  polynomial  in 
u  for  n=l,...,m.   Initially,  we  have  d   -u-t,-,,  and  from 
(8.B.1.1), 


d(2)  =  {(u-t22)(u-t11)-t12t21>/l 


Similarly,  the  terms  a  ,   and  b . .   are  polynomials  in  u. 
It  is  necessary,  therefore  to  perform  polynomial  division 
to  force  each  new  element  into  the  proper  form. 
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A  polynomial  division  algorithm  presented  by  Knuth 
(1969)  was  used:   Let  A=aQxn+...+a  _,x+a   ,  and  let 


.m, 


B=bnx  +...+b      nX+b^    ,    with  m<n.      It    is   desired  to   find 
0  m-1        m   '  — 

C=CqC  +. . .+c,  _,x+ck=A/B.   The  result  requires  n-m+1 
iterations  with  k=n-m.   At  iteration  j=0,l, . . . ,k, 


°3  ■  aJ(J>/b0 


where 


ar 


av     1)_cjbr  '  r=3,j+l,...,j+m 


a^J  1}  ,  r>j+m 


and 


a^,0)  =  ar  ,  r=0,..  .  ,n 


This  scheme  was  implemented  using  the  FORMAC 
preprocessor.   The  special  capabilities  of  FORMAC  which 
suited  it  to  this  problem  were,  In  additon  to  those  previously 
listed,  the  expression  analysis  capabilities.   In  particular, 

a.  The  ability  to  extract  coefficients  of  given  terms 
from  a  given  expression,  and 

b.  The  ability  to  determine  the  greatest  and  lowest  powers 
of  a  given  term. 

At  any  point  of  the  inversion  that  a  division  A/B 

was  required,  FORMAC  commands  determined  the  degree  of  A 
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and  B  as  polynomials  In  u,  extracted  the  coefficients  of  u^ 
in  both  expressions,  and  executed  the  division  algorithm. 

To  evaluate  this  and  the  other  methods  listed  below, 
several  semi-Markov  point  processes  were  constructed  which 
were  equivalent  to  the  Erlang  and  hyperexponential  super- 
positions using  the  methods  detailed  in  Chapter  VI.   Of 
interest  here  are  the  compact  formula  for  the  interval  spectra 
as  compared  to  those  tabulated  in  Figure  VIII. A. 11,  and  the 
plots  of  the  hyperexponential  superposition  spectra  shown  in 
Figures  VIII. B.l  and  VIII. B. 2.   Plots  of  the  Erlang  super- 
position spectra  from  this  method  are  not  shown  as  they  are 
identical  for  small  k  and  p  with  those  produced  by  the 
numerical  routine,  SPECD,  which  is  considerably  more  efficient 
in  terms  of  both  time  and  storage  requirements. 

It  should  be  noted  at  this  point  that  producing  the 
exact  polynomial  form  of  the  E(5,2)  process  interval  spectrum 
required  less  than  two  minutes  by  the  algebraic  Inversion 
method,  as  distinguished  from  the  73  minute  run  using  the 
direct  computations  of  Subsection  VIII. A. 2.   As  the 
dimension  of  the  transition  matrices  increases,  numerical 
error  seriously  interferes  with  the  results. 
VIII. B. 2.   The  Diagonalization  Method 

In  this  method  of  matrix  inversion,  it  is  necessary 
to  find  a  matrix  P  such  that  TP=PD,  where  D  is  a  diagonal 
matrix.    In  particular,  the  matrix  D  has  the  eigenvalues 


This  method  was  suggested  by  Dr.  M.  Rosenblatt  during 
a  visit  to  the  Naval  Postgraduate  School. 

22^ 


0.50 


1 

TT 


0.25 


42,(U) 


q,=.l,  c^(x)=2.76 


q^.3,  c2(x)=2.71 


q,=.5,-c^(x)=2.05 


tt/4 


tt/3 
"  ■) 


tt/2 


2tt/3       3^/4 


w 


IT 
«4 


Figure  VIII. B.l 
position  process 


Interval 
A1=.l3 


spectra  for 
q1=.lJ .3,  .5; 


;he  H(2,2;q,A) 


Ag-l-X-^, 


q2=1-ci1- 


super- 

These 


spectra  were  obtained  from  the  semi-Markov  generated  point 
process  representation  of  the  H(2,2;q,_A)  process..  Note  that 
the  sharpest  peak  results  from  the  process  in  which  the 
dominant  exponential  component  has  the  highest  intensity. 
The  coefficient  of  variation  refers  to  the  superposition 
interval. 
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Figure  VIII.  B.  2   Interval  spectra  for  the  H(2,2;q,A_)  super- 
position process  q,  =  .l,  A,  =  . 1,  .25  ,  .9  ,    A?=l-A,.   Construction 

of  this  graph  as  in  Figure  VII.B.l.   Note  that  with  the 
dominant  component  in  the  hyperexponential  distribution 
having  a  slow  rate,  X2=.l  the  spectrum  Is  nearly  flat. 
Comparison  with  Fig.  VIII. B.l  indicates  that  the  spectral 
density  is  not  closely  related  to  the  coefficient  of  variation 
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of  the  matrix  T  as  Its  diagonal  elements.   The  matrix  P  may 
be  made  up  of  linearly  independent  representations  of  the 
right  eigenvectors  associated  with  the  eigenvalues  of  T. 
Then 

•   T  =  PDP_1 


so  that 


(Iu-T)"1  =  (PP^u-PDP-1)"1 


=  P(Iu-D)_1P_1   .  (8.B.2.1) 

Clearly,  (Iu-D)  is  a  diagonal  matrix  with  elements 

u-X.,  where  X.  =  d. .  is  the  i-th  eigenvalue  of  T,  so  the 
1         1    ii 

inverse  can  be  written  directly  as 


(Iu-D)"1  =  {5  .(u-X  r1}  (8.B.2.2) 


where  6.,  is  the  Kroneker  delta. 
Referrring  to  (5.B.5), 


f+(u)    =    7TT{M2  +  M1[(Iu(co)-T)"1+(Iu(-oJ)-T)"1]M1}l 


=    TTT{M2  +  M1P[(Iu(aJ)-D)~1+(Iu(-oj)-D)~1]P~1M1}i      , 


where   u(s)    =    exp{-ls},    with   i   =     <J  -1  . 
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Substituting  from  (8.B.2.2), 
(Iu(w)-D)"1  +   (Iu(-co)-D)"1 


{6lj(u(to)-Xj)"1  +  (u(-u)-Aj)~16lj} 


{26i.(cos  u)-A.)/(l-2X,cos  w+Aj)}         (8.B.2.4) 


It  is  a  simple  matter  to  complete  the  analysis 
using  a  PORMAC  program. 

Actual  computation  of  D,  P  and  P~  made  use  of  the 
IBM  Scientific  Subroutine  Package  (SSP-36O)  routines  DEIGENP 
and  CMTRIN,  the  latter  modified  to  perform  double  precision 
arithmetic.   DEIGENP  is  a  program  which  computes  the  eigen- 
values and  eigenvectors  of  a  general  real  matrix  by  means 
of  the  Q-R  method.   (See  for  example  Stewart,  1973). 
CMTRIN  computes  the  inverse  of  a  complex  matrix  by  the 
method  of  Gaussian  elimination. 

This  method  worked  very  successfully  with  small  test 
matrices,  such  as  that  of  the  semi-Markov  generated  point 
process  equivalent  to  the  E(5,2)  process  which  had  dimension 
5  and  real  eigenvectors  and  eigenvalues.   On  larger  matrices, 
such  as  the  semi-Markov  generated  point  process  equivalent 
to  the  E(5,3)  process  which  has  dimension  15,  the  numerical 
errors  grew  to  the  point  that  meaningful  analysis  was 
impossible.   It  is  possible  that  some  error  reduction 
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techniques  might  be  applied  which  would  render  this  method 

useful  for  larger  matrices. 

No  effort  was  made  to  determine  if,  in  general,  the- 

stochastic  transition  matrices  considered  here  are 

diagonalizable .   It  was  assumed  that  such  a  procedure  was 

feasible,  presuming  that  if  the  assumption  were  false,  it 

would  be  indicated  by  the  numerical  results. 

VIII. B. 3-   The  Interval  Spectrum  by  Numerical 
Approximation 

The  definition  of  the  Interval  spectrum  of  a  semi- 
Markov  generated  point  process,  given  by  5.B.I2)  is 

f.(u>)    =    (l+4r     Z      uTM    (TJ_1-T00)M  Icos   jo)}/tt      .       (8.B.3.D 
a      j  =  l  1 

From  (5.B.15),  it  is  known  that  TJ  converges  geometrically 
to  T  ,  as  j  grows  large.  Let  brJ  _>  max{ | t .^  -t .^  | }  ,  for 
some  0<r<l.  (The  existence  of  b  and  r  are  shown  by  Kemeny 
and  Snell,1960).   Then 


00 

r^ 


I       Z        tttM    (TJ_1-TC°)M   J_i    1  1Tm?1^         £ 
j=N+l  X  L        j-N+1 


1  lTM^lbrN"1/(l-r)       .  (8.B.3.2) 


That  Is,  the  truncation  of  the  summation  in  (8.B.3.D  at 
J"N  has  error  bounded  by  the  right  hand  side  of  (8.B.3.2) 
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The  method  of  numerical  approximation  outlined  here 
is  computationally  the  most  efficient  means  of  generating 
spectral  values.   It  has  the  side  benefit  of  providing  the 
first  N  serial  covariances  directly. 

VIII. C.   THE  ARBITRARY  INTERVAL  DENSITY  OF  THE  E(k,p)  PROCESS 

In  Chapter  VII,  a  computational  form  for  the  density  of 
an  arbitrary  interval  of  an  E(k,p)  process  was  given  (7.B.6), 
with  the  product  of  two  Erlang  density  functions  given  by 
(7.B.5). 

Evaluation  of  (7.B.6)  made  use  of  two  properties  of 
FORMAC  not  previously  mentioned.   First  is  the  capability  to 
evaluate  combinatorial  expressions  such  as  f   .  J  .   The  second 
property  is  the  ability  to  manipulate  functions  in  symbolic 
form.   For  example,  H(j,n)  is  defined  by 

H(j,n)  =  (nX)JxJ'_1exp{-nXx}/{(j-l)!}   .       (8.C.1) 

Then  equation  (7.B.6)  can  be  evaluted  in  terms  of  H(j,n), 
performing  the  operations  indicated  In  (7.B.5)  at  each  step. 
The  right  hand  side  of  (8.C.1)  can  be  substituted  into  the 
final  form  for  numerical  evaluation  of  the  arbitrary  interval 
pelf,  or  the  expression  can  be  examined  as  a  linear  combina- 
tion of  Erlang  densities,  H(j,n).   The  representation  In 


Suggested  by  Professor  W.  M.  Ralke  of  the  Naval 
Postgraduate  School. 
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which  the  function  H(j,n)  was  replaced  with  the  Erlang  pdf 
was  used  to  generate  the  comparative  plots  shown  in  Figures 
VIII. C.l  through  VIII. C. 4. 

Two  features  of  the  plots  are  worth  special  note.   The 
first  Is  that  the  Initial  points  are  in  agreement  with  the 
result  stated  as  Theorem  VII. A. 1.   That  is,  for  the 
arbitrary  Interval  density  of  an  E(k,p)  superposition  process, 
with  X=k/p  the  initial  point  is 


f£p)(0+)  =  (p-l)/p   .  (8.C.2) 


A  second  point  is  that  regardless  of  the  parameters  of 
the  case,  each  arbitrary  interval  density  is  unimodal . 
While  it  has  not  been  proven  that  this  holds  generally  for 
all  k  and  p,  it  may  be  conjectured  that  this  is  the  case. 

It  is  interesting,  and  perhaps  counter-intuitive,  that 
the  distinct  shape  of  the  Erlang  density  functions  tends  to 
be  retained  more  with  k=2  than  with  higher  values  of  k.   In 
any  event,  the  special  shape  is  no  longer  apparent  for  k>^, 
and  the  superposition  pdf  looks  much  like  the  exponential. 

Because  the  final  form  of  the  density  is  a  convex  linear 
combination  of  Erlang  densities,  expectation,  variance  and 
coefficient  of  variation  can  be  obtained  directly  from  the 
moments  of  the  component  distributions  without  integration. 
Equation  (3.E.8)  gave  the  initial  value  of  the  spectrum  of 
counts  which  can  be  combined  with  the  expectation  and 
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f(t) 


:Yt(2,2) 


Figure  VIII. C.l   Arbitrary  interval  densities  for  E(2,p) 
superposition  processes,  p=2,...,8.   All  distributions 
normalized  to  unit  mean(A=k/p).   The  squares  represent  a 
unit  exponential  pdf.   The  diamonds  trace  a  Yt(2,2)  pdf. 

The  initial  points  are  (p-l)/p  for  each  curve.   This  figure 

illustrates  the  dependence  on  p  as  the  pdf  curves  rapidly 

lose  the  distinctive  Erlang  shape  and  approach  the 
exponential  curve. 
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E(3,8) 


Yt(3,3) 


Figure  VIII. C. 2   Arbitrary  interval  densities  for  E(3,p) 

superposition  processes.   Squares,  diamonds  and  normalization 
as  in  Figure  VIII. C.l.   With  k=3,  the  distinctive  shape  of 
the  Erlang  pdf  fades  more  rapidly  with  increased  p  than 
for  k=2.   The  trend  continues  with  larger  k,  so  that  by 
k=5,  p=3  the  pdf  looks  exponential. 
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JL     f(t) 


Figure  VIII. C. 3   Arbitrary  interval  densities  for  E(k,2) 
superposition  processes,  k=2,...,8.   The  squares  denote  a 
unit  exponential  pdf.   The  arbitrary  interval  pdf's  are 
normalized  to  X=k/p.   While  each  curve  has  the  common 
Initial  value  of  1/2,  the  maximum  values  diminish  and  are 
more  distant  from  the  origin  as  the  densities  seem  to  be 
taking  on  a  rectangular  form  with  increasing  k. 
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E(6,3) 


Figure  VIII. C. 4   Arbitrary  interval  densities  for  E(k,3) 
superposition  process,  k=2,...,6  normalization  as  in 
Fig.  VIII. C. 3-   Here  the  node  associated  with  the  Erlang 
pdf  has  virtually  disappeared  for  k>2.   When  p  is  increased 
beyond  3,  the  pdf's  of  the  various  processes  are  nearly 
indistinguishable,  differing  only  slightly  from  the 
exponential. 
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k 

P 

E[x] 

V[x] 

C2[x] 

g+(0+) 

f+(o 

2 

2 

Vx 

.625/X2 

.625 

.159X 

.255 

2 

3 

2/3X 

•309/X2 

.694 

•  239X 

.229 

2 

4 

1/2A 

.185/X2 

.740 

•  318X 

.215 

2 

5 

2/5X 

.124/X2 

.773 

.398X 

.206 

2 

6 

1/3X 

.088/X2 

.798 

.477X 

.199 

4 

2 

2/X 

1.82/X2 

.455 

.0398X 

.175 

H 

3 

4/3X 

1.01/X2 

.568 

.0596X 

.140 

4 

4 

vx 

.64 3/X2 

.643 

.0796X 

.124 

4 

5 

4/5X 

.445/X2 

.694 

•0995X 

.115 

4 

6 

2/3X 

.326/X2 

.734 

.1194X 

.108 

6 

2 

3/X 

3.64/X2 

.405 

.0177X 

•  131 

6 

3 

2/X 

2.14/X2 

.536 

.0265X 

.099 

6 

4 

3/2X 

1.39/X2 

.620 

.0354X 

.095 

Figure  VIII. C. 5   Data  derived  from  E(kjp)  pdf  analyses. 
Observe  that  C^(x)  decreases  with  k  and  increases  with  p 
while  f,(0+)  decreases  with  increase  in  either  k  or  p . 
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coefficient  of  variation  as  in  (7.B.11)  to  provide  the  value 
of  the  initial  point  of  the  interval  spectrum. 

The  quantities  thus  obtained  were  used  to  verify  those 
obtained  through  spectral  analysis.   In  each  case,  positive 
verification  was  achieved. 

A  summary  of  the  key  values  related  to  pdf  analysis  for 
certain  E(k,p)  processes  are  tabulated  in  Figure  VIII. C. 5. 

VIII. D.   NUMERICAL  REPRESENTATION  OF  THE  INTERVAL  BISPECTRUM 
OF  A  SEMI-MARKOV  GENERATED  POINT  PROCESS 

In  Chapter  V,  Section  C,  the  procedure  for  generating 
higher  order  spectra  was  outlined,  with  a  specific  form 
given  for  the  interval  bispectrum  of  a  semi-Markov  generated 
point  process  (5.C.10).   Evaluation  of  (5. CIO)  hinges,  as 
with  the  interval  spectrum,  on  the  matrix  (Iu-T)~  ,  as  in 
Section  3  of  this  chapter.   For  this  reason,  any  of  the 
treatments  of  Section  VIII. B  may  be  applied  to  this  problem. 
For  purposes  of  illustration,  the  numerical  approximation 
method  (VIII. B. 3)  was  selected  to  evaluate  and  plot  the 
bispectrum  of  intervals  in  the  E(5,2),  E(5,3)  and  E(3,5) 
processes  from  their  semi-Markov  generated  point  process 
representation . 

The  results  of  this  procedure  are  illustrated  In  Figures 
VIII. D.l  through  VIII. D. 6.   It  will  be  recalled  from 
Section  V.C  that  the  bispectrum  may  be  defined  on  any  one 
of  twelve  sectors  of  the  real  plane.   The  examples  Illustrated 
in  this  section  are  shown  in  the  sector  defined  by  0<Wp<w-,  <rc . 
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Two  views  are  shown  of  each  bispectru,  the  first  is  the 
view  from  the  positive  quadrant  back  toward  the  origin. 
The  second  view  is  from  the  negative  quadrant  looking  over 
the  positive  quadrant. 

Since  the  bispectrum  is  a  complex  valued  function,  it 
was  decided  to  plot  the  absolute  value  of  each  point.   Also, 
the  bispectral  values  were  scaled  by  a  factor  of  10  to 
exagerate  the  surface  shape.   With  the  scale  for  all  axes 
the  same,  the  absolute  bispectrum  looks  almost  flat,  a 
matter  of  some  concern  if  the  bispectrum  of  some  data  is  to 
be  estimated. 

VIII. E.   INTERVAL  SERIAL  CORRELATION  COEFFICIENTS 

In  a  mixed  autoregressive/moving  average  process  of 
orders  m  and  n  respectively,  It  was  noted  in  Section  III.E 
that  the  serial  correlation  coefficients  for  lags  greater 
than  n  can  be  expressed  as 


pk  =  alpk-l  +  •••  +  ampk-m    >    k>n        (8-E-1} 


A  major  portion  of  model  identification  analysis 
involves  determining  n,  m  and  {a.}  from  the  sequence  of 
serial  correlation  estimates  (Box  and  Jenkins (1970 )) . 
Where  n  and  m  and  {p,}  are  known,  the  coefficients  a.,  can 

J  J 

be  determined  from  the  linear  system 
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(tt,tt,.027) 


(tt,05.027) 


(7T,1T,0) 


(0,ir,0)  £ 


(0,0,0) 


Figure  VIII. D.l 

Absolute  bispectrum  of  the  E(5,2)  Interval  process.   This 
and  Fig.  VIII. D. 2  are  isometric  projections  of  the  E(5,2) 
bispectrum.   Only  one  octant  Is  shown  as  the  values  are 
reflected  in  the  adjacent  octant.   Interpretation  of  this 
type  of  representation  remains  an  open  question.   Construction 
of  this  and  the  following  bispectral  representations  was  by 
method  of  approximation. 
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(0,0, .07) 


(tt,0,.027 


(ir,0,0) 


Figure  VIII. D. 2 

Absolute  bispectrum  of  the  E(5,2)  interval 

process  (Reverse  view).   This  is  a  view  of 

the  E(5,2)  absolute  bispectrum  of  Intervals 

looking  toward  the  origin  from  the  first  quadrant 


(tt,tt,0) 


2^0 


(0,0, .647) 


(0,71,0) 


(0,0,0) 


Figure  VIII. D. 3   Absolute  bispectrum  of  intervals  of  the 
E(5,3)  process.   This  and  Figure  VIII. D. 4  represent  the 
absolute  bispectrum  of  the  E(5,3)  process.   The  jagged 
appearance  may  be  due  in  part  to  the  course  grid  used 
in  the  plot  (40  x  40) . 
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(0,0,. 647) 


(tt,0,.23) 


(tt,0,0) 


(tt,tt,0) 


Figure  VIII. D. 4   Absolute  bispectrum  of  intervals  for  the 
E(5,3)  process  (reverse  view).   This  is  a  view  of  the  E(5,3) 
absolute  bispectrum  looking  back  toward  the  origin  from  the 
first  quadrant.   !!ote  that  the  magnitude  of  the  peaks  is 
about  10  times  that  of  the  E(5,2)  process. 


2^2 


(tt,tt,  .0197) 


(71,71,0) 


(0,TT,0) 


Figure  VIII. D. 5 

Absolute  blspectrum  of  Intervals  of  the 
E(3,5)  process.   This  and  Figure  VIII. D. 6 
are  isometric  projections  of  the  E(3»5) 
absolute  interval  bispectrum.   Note  the 
relatively  flat  appearance,  nearly  vanishing 
at  the  origin.   This  is  similar  to  the  second 
order  spectrum  which  flattens  with  Increased  p 


(0,0,. 00027) 


■1J3 


(0,0,. 00027) 


(tt,0,.0197)X 


(tt,0,0) 


(tt,tt,0) 


Figure  VIII. D. 6   Absolute  bispectrum  of  the  E(3,5)  interval 
process  (reverse  view) .   Observe  that  the  surface  is 
slightly  wavey  with  the  highest  peak  at  (tt/2  , tt/2)  ,  with 
secondary  peaks  at  (3^/^,3^/^),  (  tt  ,  tt/2  )  and  (tt,3tt/4). 
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(8.E.2) 


If  the  actual  order  of  the  process  is  (m',n'),  the 
following  result   is  obtained  from  solution  of  the  system 
given  by  (8.E.2)  : 


n'<n  and  m>m' 


n '  >n  or  m1 >m 


The  matrix  of  correlation  coefficients 
will  be  singular 

Equation  (8.E.1)  will  not  be  satisfied 
for  k>n+m  using  the  coefficients 
derived  from  (8.E.2) . 


This  idea  leads  to  a  procedure  for  verification  of  the 
results  of  Section  III.D  wherein  a  method  is  presented  for 
determining  the  order  of  the  polynomials  which  make  up  the 
interval  spectrum  of  an  E(k,p)  process. 

When  the  process  being  studied  has  been  given  an 
equivalent  semi-Markov  generated  point  process  representation, 
the  serial  coefficients  may  be  obtained  directly  form  (5.3.3) 
and  (5.B.*J)  which  give  the  covariance  and  variance  as 
functions  of  powers  of  the  transition  matrix,  T.   If  only  a 
spectral  representation  is  available,  as  for  example  output 
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of  SPECD  (Subsection  VIII.A.l),  the  spectrum  must  be  inverted 
to  produce  the  serial  correlation  coefficients. 
Recall  from  (2.A.3.3)  that 


f.(w)    =    {1   +    2      Z      p.cos    jco}    /ir        ,      0<oj<tt    .         (8.E.3) 

j=l   J 


The  inverse  relation  (see  for  example  Cox  and  Lewis (i960, 
Ch.  *0)  is 


p.  =  /   f.(w)  cos  joj  doj  (8.E.4) 

J    0 


A   discrete   approximation   of    (8.E.3) 

N 

f.(«_)    =    (1  +   2      Z      tt,    cos   ju>    }/tt      ,  (8.E.5) 

n  J=1      j  n 

where  to  =  im/N.  n=0,....N-l.   The  inverse  relation  of 

n       '  '         * 

(8.E.5)  is 

tt   N"1 

p    =  rr     Z  f  (U  )  COS  j  CO    ,    j  =  0  ,  1  ,  .  .  .  ,N- 1   . 

J      n=0 

(8.E.6) 


where  tt/N  represents  the  separation  between  to  and  oj  , ,  . 
*  r  n      n+1 

The  equations  (8.E.5)  and  (8.E.6)  represent  a  finite 
Fourier  transform  pair,  with  communication  between  the  two 
representations  easily  handled  by  the  Fast  Fourier  Transform 
Algorithm  (See  for  example  Cooley,  Lev/is  and  Welch  (1967)). 
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The  key  property  of  the  finite  Fourier  transform  which  is 
the  basis  for  the  fast  Fourier  transform  is  that  the  transform 
of  a  sequence  of  M=2   points  can  be  written  as  the  sum  of  n 
transforms  of  lengths  2,  2,  22,  23,...,  2n-1  .   Since  each 
transform  of  length  r  requires  approximately  r   operations, 
the  number  of  steps  required  by  the  fast  Fourier  transform 

is  nN=Nlog„N  as  compared  with  an  N  point  transform  requiring 

2 

N   operations. 

The  program  package  FORT/RFORT  supplied  by  IBM  was  used 
in  this  analysis.   Figure  VIII. E.l  is  a  comparison  of  the 
E(8,2)  process  correlation  structure  as  determined  by  SPECD, 
FORT/RFORT,  and  as  determined  by  the  approximation  method 
applied  to  the  semi -Markov  representation  of  this  process. 
The  parameter  k=8  accentuates  the  differences  in  the 
procedures  which  are  indistinguishable  for  smaller  k. 

The  correlation  structure  of  additional  processes  is 
tabulated  in  Appendix  D. 

VIII. F.   COUNT  SPECTRA  OF  THE  E(k,p)  PROCESS 

The  second  order  count  spectrum  of  an  E(k,p)  process  is 
given  by  (3.C.6).   Direct  numerical  evaluation  of  this  form 
for  various  values  of  k  is  shown  in  Figure  VIII. P. 1.   Because 
the  count  spectrum  is  linear  in  p ,  a  value  of  p=l  has  been 
used  for  all  computations.   Two  features  are  readily 
apparent  from  inspection  of  Figure  VIII. P. 1.   The  first  is 
that  for  small  k  after  the  Initial  fluctuation  the  spectrum 
of  counts  converges  rapidly  to  1/tt.   This  fact  is  readily 

verified  by  taking  the  limit  gj-°°  in  Equation  (3.C.7). 
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Figure  VIII. E.l  Comparison  of  SPECD  and  the  approximation 
method  of  spectral  representation. 

The  accuracy  and  efficiency  of  two  methods  used  for 
numerical  approximation  of  the  interval  second  order  spectrum  • 
of  the  E(k,p)  process  are  compared  for  the  E(8,2)  process. 

Method  1.   Numerical  approximation  of  the  spectrum  using 
SPECD  (VIII. A. 1).   Fast  Fourier  transform  of 
spectrum  to  determine  correlations  and  damping 
coefficients  (32,768  and  4096  point  approximations) 

Method  2.   Numerical  approximation  of  the  equivalent  semi- 
Markov  generated  point  process  (VIII. B. 3) 


METHOD    1 

METHOD   2 

Number   of  points 

32,768 

4096 

200 

CPU  Time 

8  min 

1  min 

6    sec 

Core 

448K 

202K 

248K 

Spectrum 

Same 

Same 

Same 

Correlations:    1 
2 

3 
4 

-0.52122 

0.28153 
-0.14812 
0.078694 

-0.52123 
0.28154 

-0.14812 
0.078695 

-0.52123265925713 
0.28153949321523 

-0.14813039868207 
0.078699294631380 

Coefficients      1    -0.0091941  -0.011426 

2  0.13558  0.16640 

3  -0.24262  -0.17664 

,-6 


Error 


10 


10 


-5 


0.000015253401560525 
0.032958990549093 
-0.46874998699262 

lO"1^ 


The  differences  in  precision  between  Methods  1  and  2 
lie  in  the  fact  that  only  single  precision  results  are 
returned  from  SPECD  and  FGRT/RFORT  although  double  precision 
arithmetic  is  used  in  both  programs. 

The  E(8,2)  case  accentuates  differences.  In  those  cases 
for  which  the  spectrum  has  a  flatter  appearance,  the  damping 
coefficients  are  nearly  the  same  from  either  method. 

The  error  Is  based  on  the  comparisons 


pn+l:pn+l  =  pnal  + 


n-rr.+  l  n 


and 


pn+2:pn+2  =  Dn+lal  + 


n-m+2  m 
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The  second  observation  from  Figure  VIII. F.l  is  that 
the  count  spectra  doe  not  exhibit  the  strong  dependence  on 
k  observable  in  the  Interval  spectra. 
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APPENDIX  A   NOTATION 


1.   General  Forms 

F(x),  F  (x):    probability  distribution  functions 

R(x),  R  (x) :    survivor  functions 

Z(x):  equilibrium  excess  (forward  recurrence 

time)  distribution 

f(x),  f  (x):    probability  density  functions 

E(-),    Var(-):   expected  value  and  variance 

o(h):  a  function  that  vanishes  more  rapidly 

than  h 

C(«):  coefficient  of  variation 


Conventions 

Superscript  *:  Laplace  transform 

Superscript  (p):   The  superscripted  symbol  refers  to  a 

superposition  point  process 

X,X  •  scale  parameters  of  Erlang  and  hyper- 

J  exponential  distributions 

y:  the  expected  value  of  an  Interval  in  a 

renewal  process,  or  an  arbitrary  interval 
in  a  stationary  point  process 

2 

a  :  the  variance  of  an  interval  in  a  renewal 

process,  or  an  arbitrary  interval  in  a 
stationary  point  process 

[xj  :  the  largest  integer  less  than  or  equal 

to  x 

lid:  independent,  identically  distributed; 

refers  to  either  random  variables  or 
component  processes  in  a  superposition 

Script  upper  case  letters:   sets;  vectors 

Script  lower  case  letters:   sets,  vectors 
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Underlined  lower  case  letters:   vectors 

Gothic,  upper  case  letters:   matrices 

Reserved  symbols:   Unless  otherwise  specifically  noted, 

k  is  the  shape  parameter  of  an  Erlang 
distribution;  p  is  the  number  of 
components  in  a  superposition 

Point  Process  Notation 

N(t):  asynchronous  counting  process  (II. A. 1) 

Nf(t):  synchronous  counting  process  (II. A. 1) 

{X  }:  synchronous  interval  process  (II. A. 1) 

{W,L  ,L„ , . . . } :  asynchronous  interval  process  (II. A. 1) 

M(t):  asynchronous  mean-time  curve  (2. A. 2. 2) 

m(t),m:  asynchronous  intensity  (2. A. 2. 5) 

Mf(t):  synchronous  mean-time  curve  (2. A. 2. 4) 

mf(t):  synchronous  intensity  (2. A. 2. 6) 

V(t):  variance-time  curve  (2. A. 2. 3) 

y(x):  covariance  density  of  the  counting  process 

(2. A. 2. 10) 

g  (to):         second  order  spectrum  of  counts  (2. A. 2. 13) 

<J>(z,t):        generating  function  of  the  asynchronous 

counting  process  (2. A. 3. 4) 

f,  (to):         second  order  spectrum  of  counts  (2.A.3-3) 

{p.}:  serial  correlation  sequence  (2. A. 3.7) 

J 

Semi-Markov  Generated  Point  Process  Notation 
T  =  {t  ,}:     Transition  matrix  (V.A) 

F(u)  =  {f  , (u)}:   transition  time  pdf  matrix  (V.A) 

( r )  r 

E   =  {y , ,  }  =  (E  S    } :   matrix  oV   r-th  transition  time 

r      J  J      moments  (V.A) 
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tt:  stationary  vector  associated  with 

(5. A. 1.4) 

G(u)  =  {t  .f. , (u)}:   weighted  transition  time  pdf 
1J  1J       matrix  (V.B) 

M   =  {t..VK.  }:   weighted  r-th  moment  matrix  (V.B) 

T  :  the  steady  state  transition  matrix  (5.B.2) 

y(j):  interval  covariance  of  j  lags  (5.B.9) 

T(jjk):        interval  trivariance  of  j  and  k  lags 

(5.C1) 

* 

t  (a3b):       Laplace  transform  of  x(J,k),  0  <  j  <  k 

(5.C15) 

* 

t  (a):         Laplace  transform  of  t(j,j)3  0  <  j 

(5. CIO) 

* 

x  (a):         Laplace  transform  of  x(o,j),  0  <  j 

(5.C.17) 


o 


a:b:  transition  from  state  a  tc  b 

b(w, ,Wp):      the  bispectrum  of  intervals 

Special  Notation 

E(k,p):        the  superposition  of  p  lid  k-Erlang 

renewal  processes  (II. A. 5) 

H(k,p;q,A:):     the  superposition  of  p  iid  hyperexponential 

processes  with  parameter  vector  A_  and 
probability  mass  function  q.  (II. A. 5) 

ARMA(m,n):      an  autoregressive/moving  average  process 

of  degrees  m  and  n  respectively  (I.F.I) 

a-pb-pCj:       individual  terms  in  the  E(k,p)  interval 

spectrum  (3. A. 1.23) 

a.  ,b. ,c,  :       individual  terms  in  the  E(k,p)  interval 

spectrum:  revised  index  (3-A.2.3) 

1/    (p):       special  index  set  for  the  E(k,p)  Interval 

spectrum  -  k  even  (3.C.3) 

Yt(k,A):       the  k-Erlang  pdf  (2. A. 5.1) 
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APPENDIX  B:   COSINE  CONVERSION  FORMULA 

k       k 
1.   Convert  cos  to  to   I   a,  .cos  j to 

J-0      KJ 


k 

cos  u  = 


2~  (a,  n+cx,  _cos  2u+ol  ucos  4co+.  .  ,+cl ,  cos  kco),     k  even 


— k 
2     (a, cos  oj+ol  _cos  3urK .  .+a, .  cos  kco),     k  odd 


ak0  =  °k-l,l    '  k=2^>6>--- 

akl  =  2ak-l,0  +  ak-l32     ■  k=3>5,... 

akn  =  ak-I,n-l  +  ak-l,n+l   >  n=2  '  3  ' '  ■  '  »k"1  '>      k=3^,5, 

ank  =  1   ,   k=l32,3,45... 

a10  =  a01  =  1 

k 

2.   Convert  cos  kco  to   E   a.cosJto  (Tschebyshef f  Polynomials) 


cos  Ooi  =  1 

cos  Ioj  =  cos  to 

cos  koj  =  2cos  to  cos{(k-l)co}  -  cos{  (k-2  )to} ,   k=3,^>5 
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APPENDIX  C 


Transition  probability  matrix  of  the  semi-Markov  generated 
point  process  equivalent  to  the  E(2j3)  process 
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Transition  density  shape  parameter  matrix  of  the  semi-Markov 
point  process  equivalent  to  the  E(2,3)  process 
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Transition  probability  matrix  of  the  semi-Markov  generated 
point  process  equivalent  to  the  E(2,4)  process 
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Transition  density  shape  parameter  matrix  of  the  semi-Markov 
point  process  equivalent  to  the  E(23^)  process 
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Transition  probability  matrix  of  the  semi-Markov  generated 
point  process  equivalent  to  the  E(2,5)  process 
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Transition  density  shape  parameter  matrix  of  the  semi-Markov 
point  process  equivalent  to  the  E(2,5)  process 
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Transition  probability  matrix  of  the  semi-Markov  generated 
point  process  equivalent  to  the  E(3,2)  process 
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Transition  density  shape  parameter  matrix  of  the  semi-Markov 
point  process  equivalent  to  the  E(3j2)  process 
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Transition  probability  matrix  of  the  semi-Markov  generated 
point  process  equivalent  to  the  E(3,3)  process 
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Transition  density  shape  parameter  matrix  of  the  semi-Markov 
point  process  equivalent  to    the  E(3,3)  process 
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Transition  probability  matrix  of  the  semi-Markov  generated 
point  process  equivalent  to  the  E(5,2)  process 
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Transition  density  shape  parameter  matrix  of  the  semi-Markov 
point  process  equivalent  to  the  E(5,2)  process 
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Transition  probability  matrix  of  the  semi-Markov  generated 
point  process  equivalent  to  the  E(8,2)  process 
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Transition  density  shape  parameter  matrix  of  the  semi-Markov 
point  process  equivalent  to  the  E(8,2)  process 
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APPENDIX  D 


n     .  ,       -       r   i  n 


Serial  correlations,  {p*}.-  and  damping  factors  {<*.}, 
for  selected  E(k,p)  processes.   Each  E(k,p)  process  has  a 
similar  ARMA(m,n)  process,  with  m  and  n  estimated  in 
Figure  III.C.l.   For  indices  greater  than  n,  the  serial 
correlation  is  given  by 


p ,  =  p .  ,  a,  +  .  .  .  +  p .   a   ,     j  >n 
Mj     J-l  1  j-m  m  '     ° 


Those  processes  marked  with  a  single  asterisk  had 
correlations  computed  from  their  semi-Markov  generated 
point  process  representation  using  (5.B.3)  and  (5-6.4). 
Correlations  for  the  remaining  processes  were  determined 
from  a  fast  Fourier  transform  of  the  interval  spectrum  as 
determined  by  SPECD.  (VIII. A. 1  and  VIII. E) 

Processes  marked  with  a  double  asterisk  have  parameters 
m  or  n  less  than  indicated  in  Figure  III.C.l. 

Process:   E(2,2)  Similar  Process  :ARMA(0 , 1 ) 

1        -0.1 

2,3,...   0  2,3,...    0 

lei  =  0 
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Process:   E(2,3)* 


Similar  Process:   ARMA(1,2) 


1 
2 


J 

1 
2 
3 


-0.10444 
-0.03160 


Process:   E(2,4)* 


-0.09796 
-0., 04428 
-0.01503 


Process:   E(2,5)* 


J 


1 

-0.09022 

2 

-0.04898 

3 

-0.02225 

4 

-0.00925 

Process :   E(2 ,6 ) 


1         .11111    (1/9) 
|e|  <  10"15 
Similar  Process:   ARMA(1,3) 

1  .25    (1/4) 

|e|  <  io-15 

Similar  Process:   ARMA(2,4) 
i         a, 


1 

2 


-0.01434 
0.4 


|e|  <  10"15 
Similar  Process:   ARMA(2,5) 


a. 


1 

2 

3 

4 

5 

-0.08303 
-0.05022 

-0.02773 
-0.01398 

-0.00655 

1 
2 

1      -9 
|  <  10  y 

.05004 
.55697 

ocess  : 

E(3,2)* 

Simll 

ar 

Process : 

ARMA (1,2) 

1 

2 


n 

-0.20341 
-0.03452 


a 


1        -0.125   (1/8) 
|e|  <  10"15 
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Process 
J 

1 
2 

Process 

3 

1 
2 

3 

4 

5 
6 

Process : 
J 

1 
2 

3 
1 

5 
6 
7 
8 

Process : 
J 

1 
2 

Process : 
J 

1 
2 

3 


E(3,3)* 

-0.18847 
-0.05^55 


E(3,4) 


-0 

-0 
-0 

0 
0 
0 


16469 
08044 

01731 
00746 
00310 
00044 


E(3,5)* 


PJ 


-0. 14*U2 

-0.08673 
-0.03744 
-0.00656 
0.00392 
0.00270 
0.00099 
0.00018 


EC4,2) 


p1 


-0.29238 
0.83825 


E(4,3) 


-0 
-0 
0 
-0 
-0 


24870 
07548 
04852 
00118 
00442 


Similar  Process:   ARMA(2}4) 
i         o4 


1 
2 


-0.03704 
1.6*io-12 


,-14 


|e|  <  10' 
Similar  Process:   ARMA(4,6) 
i         a, 


1 

-0.00426 

2 

-0.02583 

3 

0.02192 

l| 

-0.18688 

|e|  <  10~8 
Similar  Process:   ARMA(6,8)** 


1 

2 

0.0000025 
0.00016 

5 

4 

-0.00251 
-0.00681 

5 
6 

-0.09253 
0.45096 

|e|  <  10~18 
Similar  Process:   ARMA(1,2) 

1  -0.25     (1/4 

|e|  <  10~6 
Similar  Process:   ARMA(3,5) 
1         a, 


1 

-0.02464 

2 

-0.14004 

3 

-0.43167 

|e|  <  10 


-7 
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Process : 

E(4,4) 

J 

fi 

1 
2 

3 

4 

5 
6 

7 
8 

-0.20728 

-0.11047 

-0.01699 

0.02770 

0.00493 

-0.00223 

-0.00147 

0.00008 

Process : 

E(5,2)* 

J 

fl 

1 
2 
3 

-0. 36619 

0.13681 

-0.04711 

Process:   E(5,3)* 
J        P, 


1 

2 
3 

-0.29176 

-O.09656 

0.08688 

4 
5 
6 
7 
8 

-0.01020 

-0.01068 

0.00478 

0.00028 

-0.00084 

Process:   E(6}2) 
J        P, 


1 
2 
3 


-0.42728 

0.18853 

-0.07884 


Similar  Process:   ARMA(5,8) 
i         a, 


1 
2 

3 

4 

5 


0.02325 
0.07804 
0.02958 
0.52518 
0.46057 


|e|  <  10"10 
Similar  Process:   ARMA(2,3) 
i         a, 


1 

2 


0.000977 
-0.3437 


|e|  <  10"1J4 
Similar  Process:   ARMA(6,8) 


1 

2 

3 

4 

5 

6 


0.0000158 
0.000874 
-0.0042? 
-0.87306 
-1.80986 
-5.75229 


|e|  <  10"19 
Similar  Process:   ARMA(2,3) 


1 
2 


0.00613 
-0.40735 


|e|  <  io"6 
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Process:   E(6,3) 


Similar  Process:   ARMA(6,8) 
i         a, 


1 

-0.32458 

2 

-0.11478 

3 

0.12700 

H 

-0.02400 

5 

-0.01846 

6 

0.01257 

7 

-0.00084 

8 

-0.00245 

1 

2 

3 
4 


1 

0.02899 

2 

-0.43110 

3 

-0.01320 

4 

-0.02046 

5 

-0.80478 

6 

-0.04981 

Process:   E(852)* 
J        P. 


|e|  <  10  u 

Similar  Process:   ARMA(3,4) 


-0.52123 

0.28153 

-0.14813 

-0.07870 


a 


1 
2 
3 

|e|  <  10 


0.00001526 
0.03296 

-0.46875 

-14 
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1.   SPECD 


APPENDIX  E:   COMPUTER  PROGRAMS 
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